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(54) DEVICE AND METHOD FOR IMAGE PROCESSING AND NAVIGATION DEVICE 

(5 7) Abstract: J 
PROBLEM TO BE SOLVED: To provide an on-vehicle II 
image processor and an on-vehicle navigation device 
which maintain the safety of a traveling vehicle and can 
also acquire road width data by imaging sides from the 
traveling vehicle and performing image processing. 
SOLUTION: An image signal from a CCD camera 19a 
imaging sides of a vehicle is inputted to an image 
processing part 1 8 included in a navigation device, and 
converted into a digital image signal by an A/D converter 
21 to be frame image data having a prescribed frame cycle. 
Two pieces of continuous frame image data are 
respectively stored in 1 st and 2nd image memories 22 and 
23. A motion vector detecting part 24 detects a motion 
vector in each area of the image on the basis of these frame 
image data and vehicle speed data, and a motion vector 
processing part 25 calculates a distance to a road edge 
from the vehicle on the basis of the motion vector. Further, 
the width of a road where the vehicle travels can be 
calculated from the distance. Thus, an alarm is issued to a *TJ 
driver when the vehicle approaches the road edge, a traffic lane on which the vehicle travels is 
decided to guide the driver to a right lane, the width of the road is stored to be effectively utilized 
later so that the safety and convenience of the vehicle can be improved. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The image processing system characterized by to have an image pick-up means to 
picturize the side of a mobile and to output a picture signal, a movement vector detection means to 
detect a movement vector for every field of the picturized image based on said picture signal which a 
mobile is moving, and a distance calculation means distinguish said detected spatial rate of change of 
the magnitude of a movement vector, and compute the distance to a road edge based on this rate of 
change. 

[Claim 2] Said distance calculation means is an image processing system according to claim 1 
characterized by computing the 1 st distance to a left-hand side road edge, and the 2nd distance to a 
right-hand side road edge including 1st image pick-up means by which said image pick-up means 
picturizes the left-hand side side of a mobile, and the 2nd image pick-up means which picturizes the 
right-hand side side of a mobile. 

[Claim 3] The image processing system according to claim 2 characterized by having further a 
width-of-road calculation means to compute the width of road of the transit road of a mobile, based 
on said the 1st distance and said 2nd distance. 

[Claim 4] It is an image processing system given in either of claim 1 to claims 3 which said picture 
signal is constituted considering frame image data with a predetermined frame period as a unit, and 
are characterized by said movement vector detection means detecting said movement vector based 
on two continuous frame image data. 

[Claim 5] Said image pick-up means is an image processing system given in either of claim 1 to 
claims 4 characterized by being installed in a before [ a mobile ] side. 

[Claim 6] Said image pick-up means is an image processing system given in either of claim 1 to 
claims 5 characterized by picturizing the side of the approach before slant of a mobile. 
[Claim 7] Said image pick-up means is an image processing system given in either of claim 1 to 
claims 6 characterized by picturizing the side of the bottom approach of slant of a mobile. 
[Claim 8] It is the image-processing approach of performing an image processing based on the 
picture signal outputted from an image pick-up means to picturize the side of a mobile. The 
movement vector detection process of detecting a movement vector for every field of the picturized 
image based on said picture signal which a mobile is moving, The image-processing approach 
characterized by having the distance calculation process which distinguishes the spatial rate of 
change of the magnitude of said detected movement vector, and computes the distance to a road edge 
based on this rate of change. 

[Claim 9] It is the image-processing approach according to claim 8 which said picture signal is 
outputted, respectively from the 1 st image pick-up means which picturizes the left-hand side side of 
a mobile, and the 2nd image pick-up means which picturizes the right-hand side side of a mobile, 
and is characterized by said distance calculation process computing the 1 st distance to a left-hand 
side road edge, and the 2nd distance to a right-hand side road edge. 

[Claim 10] The image-processing approach according to claim 9 characterized by having further the 
width-of-road calculation process which computes the width of road of the transit road of a mobile 
based on said the 1st distance and said 2nd distance. 

[Claim 1 1] It is the image-processing approach given in either of claim 8 to claims 10 which said 
picture signal is constituted considering frame image data with a predetermined frame period as a 
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unit, and are characterized by said movement vector detection process detecting said movement 
vector based on two continuous frame image data. 

[Claim 12] The sensor section which is navigation equipment which performs path guidance from 
the current position of a car to the destination based on map data, and contains the speed sensor 
which detects the passing speed of a car, An image pick-up means to picturize the side of a car and 
to output a picture signal, and a movement vector detection means to detect a movement vector for 
every field of the picturized image based on said picture signal under car transit, Navigation 
equipment characterized by having a distance calculation means to distinguish the spatial rate of 
change of the magnitude of said detected movement vector, and to compute the distance to a road 
edge based on this rate of change and said passing speed. 

[Claim 13] Navigation equipment according to claim 12 characterized by having further a notice 
means to notify of the car having approached the road edge when said computed distance is smaller 
than the value set up beforehand. 

[Claim 14] Navigation equipment according to claim 12 or 13 characterized by having further a 
width-of-road calculation means to compute the width of road of the transit road of a car, based on 
said computed distance. 

[Claim 15] Navigation equipment according to claim 14 characterized by having further a width-of- 
road data storage means to relate the width-of-road data corresponding to said computed width of 
road with said map data, and to memorize them possible [ updating ]. 

[Claim 16] Navigation equipment according to claim 14 or 15 characterized by having further a slow 
lane judging means to judge the slow lane of a car based on the calculation result of said distance 
calculation means and said width-of-road calculation means, and a lane notice means to notify of the 
proper lane should collate said judged slow lane with the optimal path to said destination, and it 
should run based on this collating result. 

[Claim 17] the case where, as for said lane notice means, said judged slow lane does not agree into 
said proper lane — this ~ the navigation equipment according to claim 16 characterized by notifying 
of a proper lane. 

[Claim 18] the case where, as for said lane notice means, said judged slow lane agrees into said 
proper lane — this — the navigation equipment according to claim 16 characterized by notifying of 
agreeing into a proper lane. 



[Translation done.] 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention belongs to the technical field of the image processing system 
and the image-processing approach of asking for the distance and the width of road to a road edge 
based on the picture signal from an image pick-up means, and navigation equipment in the car under 
transit. 
[0002] 

[Description of the Prior Art] The navigation equipment which displays the current position which 
detected the current position of the car as a mobile and was detected with the surrounding road map 
from the former on a display screen, and performs path guidance is used widely. In this kind of 
navigation equipment, it has the mass record medium with which map data were memorized, and it 
is used in order to generate the indicative data on a display screen. In addition to data, various data 
for a display, etc. about a road configuration, the width-of-road information which accompanies this 
is included in the map data on a record medium. Therefore, the width-of-road information 
corresponding to the road under transit can be read, and the width of road of the road it is running 
now can be grasped. 
[0003] 

[Problem(s) to be Solved by the Invention] However, with the above-mentioned conventional 
navigation equipment, the width-of-road information included in map data does not show the exact 
width of road, and showed the width of road of the outline of the road like 5.5m-8m with it. 
Therefore, the fine exact width-of-road information corresponding to the point of a road was 
unacquirable. Furthermore, it not only gets to know the width of road of a road, but it asks real time 
for the distance to a road, and the needs for using this for insurance transit of a car are strong. 
[0004] Then, by making this invention in view of such a problem, and detecting the structures other 
than the path road surface which adjoins a wall surface, and a slot or a path road surface out of an 
image based on the image picturized from the car under transit It aims at offering the navigation 
equipment which can perform warning and guidance for securing insurance transit to a driver 
according to the result of the image processing system for mount which can ask for the distance and 
the width of road to a road edge, and an image processing. 
[0005] 

[Means for Solving the Problem] In order to solve the above-mentioned technical problem, an image 
processing system according to claim 1 An image pick-up means to picturize the side of a mobile 
and to output a picture signal, and a movement vector detection means to detect a movement vector 
for every field of the picturized image based on said picture signal which a mobile is moving, The 
spatial rate of change of the magnitude of said detected movement vector is distinguished, and it is 
characterized by having a distance calculation means to compute the distance to a road edge based 
on this rate of change. 

[0006] According to this invention, with an image processing system, in mobiles, such as a car under 
transit, the image pick-up by the image pick-up means is performed towards the side, and a picture 
signal is outputted. This picture signal is compared at the two times, and the movement vector for 
every field is detected. Although the rate of change of a movement vector serves as abbreviation 
regularity in parts for a horizontal level, such as a path road surface in an image, the break point of 
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rate of change arises at a road edge. Therefore, it can distinguish for every fields of these, a road 
edge can be distinguished, and the distance to a road edge can be further computed based on the 
magnitude of a movement vector. Therefore, the computed distance is available for applications, 
such as security under transit, and exchange of navigation, and can raise the safety and convenience 
of a car. 

[0007] Said distance calculation means is characterized by computing the 1st distance to a left-hand 
side road edge, and the 2nd distance to a right-hand side road edge including 1st image pick-up 
means by which, as for said image pick-up means, an image processing system according to claim 2 
picturizes the left-hand side side of a mobile in an image processing system according to claim 1, 
and the 2nd image pick-up means which picturizes the right-hand side side of a mobile. 
[0008] Towards left-hand side, towards right-hand side, the 2nd image pick-up means picturizes, 
respectively, and, according to this invention, the 1st image pick-up means outputs a picture signal 
by mobiles, such as a car under transit. Like invention according to claim 1 , subsequent processing is 
performed about a right-hand side image and a left-hand side image, and can compute the distance to 
the both-sides road edge of a mobile. Therefore, two computed distance is acquired, and grasp of the 
car location in a transit road becomes easy, and can raise the safety and convenience of a car further. 
[0009] An image processing system according to claim 3 is characterized by having further a width- 
of-road calculation means to compute the width of road of the transit road of a mobile, based on said 
the 1st distance and said 2nd distance in an image processing system according to claim 2. 
[0010] According to this invention, based on two distance computed corresponding to the image of 
the right and left in mobiles, such as a car, the width of road of a transit road is computable. For 
example, when the image pick-up means is installed in the flank of car both sides, if two distance is 
applied and the distance between image pick-up means is applied further, the width of road will be 
obtained. Therefore, using this width of road, the insurance under transit is secured or it becomes 
useful to the improvement in functional of the security and navigation of a car, such as acquiring 
width-of-road data. 

[001 1] Said picture signal is constituted considering the frame image data in which an image 
processing system according to claim 4 has a predetermined frame period in an image processing 
system given in either of claim 1 to claims 3 as a unit, and said movement vector detection means is 
characterized by detecting said movement vector based on two continuous frame image data. 
[0012] According to this invention, the object of an image processing is frame image data outputted 
for every frame period, and an above-mentioned image processing is performed using two 
continuous frame image data. Therefore, an image processing is always carried out to real time 
during transit of a car, and the image processing system which can respond to the situation of a car 
promptly can be realized. 

[0013] An image processing system according to claim 5 is characterized by being installed in a 
before [ a mobile ] side by said image pick-up means in an image processing system given in either 
of claim 1 to claims 4. 

[0014] displaying the picture signal from the image pick-up means installed in the before [ a mobile ] 
side on the display screen according to this invention ~ the above-mentioned operation — in addition, 
a check by looking usually checks easily the longitudinal direction by the side of before [ difficult ] a 
mobile by looking — things can be carried out and it becomes much more useful at the security of a 
car. 

[0015] An image processing system according to claim 6 is characterized by said image pick-up 
means picturizing the side of the approach before slant of a mobile in an image processing system 
given in either of claim 1 to claims 5. 

[0016] Since it was made to perform above-mentioned processing based on the picture signal from 
an image pick-up means to picturize the approach before slant of a mobile according to this 
invention, the distance to the road edge in the travelling direction front of a car can be computed by 
preceding it in time, and the run state of a car can be grasped quickly. 

[0017] An image processing system according to claim 7 is characterized by said image pick-up 
means picturizing the side of the bottom approach of slant of a mobile in an image processing system 
given in either of claim 1 to claims 6. 

[0018] Since it was made to perform above-mentioned processing based on the picture signal from 
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an image pick-up means to picturize the bottom approach of slant of a mobile according to this 
invention, even if it is the case where a road edge is approached, into a field angle, it becomes easy 
to catch a road edge and the safety of a transit car can be raised further. 

[0019] The image-processing approach according to claim 8 is the image-processing approach of 
performing an image processing based on the picture signal outputted from an image pick-up means 
to picturize the side of a mobile. The movement vector detection process of detecting a movement 
vector for every field of the picturized image based on said picture signal which a mobile is moving, 
The spatial rate of change of the magnitude of said detected movement vector is distinguished, and it 
is characterized by having the distance calculation process which computes the distance to a road 
edge based on this rate of change. 

[0020] According to this invention, the picture signal from the image pick-up means installed in 
mobiles, such as a car under transit, is inputted, according to the same operation as invention 
according to claim 1 , a road edge can be distinguished and the distance to a road edge can be further 
computed based on the magnitude of a movement vector. Therefore, the computed distance is 
available for applications, such as security under transit, and exchange of navigation, and can raise 
the safety and convenience of a car. 

[002 1 ] The image-processing approach according to claim 9 is outputted for said picture signal in the 
image-processing approach according to claim 8, respectively from the 1st image pick-up means 
which picturizes the left-hand side side of a mobile, and the 2nd image pick-up means which 
picturizes the right-hand side side of a mobile, and said distance calculation process is characterized 
by computing the 1st distance to a left-hand side road edge, and the 2nd distance to a right-hand side 
road edge. 

[0022] According to this invention, the picture signal corresponding to the left-hand side side from 
the 1st image pick-up means installed in mobiles, such as a car under transit, and the picture signal 
corresponding to the right-hand side side from the 2nd image pick-up means are inputted, 
respectively, and the distance to the both-sides road edge of a mobile can be computed according to 
the same operation as invention according to claim 2. Therefore, two computed distance is acquired, 
and grasp of the car location in a transit road becomes easy, and can raise the safety and convenience 
of a car further. 

[0023] The image-processing approach according to claim 10 is characterized by having further the 
width-of-road calculation process which computes the width of road of the transit road of a mobile 
based on said the 1st distance and said 2nd distance in the image-processing approach according to 
claim 9. 

[0024] According to this invention, it becomes useful to the improvement in functional of the 
security and navigation of a car, such as the width of road of a transit road being computable, and 
securing the insurance under transit or acquiring width-of-road data using this width of road, 
according to the same operation as invention according to claim 3. 

[0025] Said picture signal is constituted considering the frame image data in which the image- 
processing approach according to claim 1 1 has a predetermined frame period in the image- 
processing approach given in either of claim 8 to claims 10 as a unit, and said movement vector 
detection process is characterized by detecting said movement vector based on two continuous frame 
image data. 

[0026] Since an above-mentioned image processing is performed by the same operation as invention 
according to claim 4 using two continuous frame image data according to this invention, an image 
processing is always carried out to real time during transit of a car, and the image-processing 
approach which can respond to the situation of a car promptly can be offered. 
[0027] The sensor section which navigation equipment according to claim 12 is navigation 
equipment which performs path guidance from the current position of a car to the destination based 
on map data, and contains the speed sensor which detects the passing speed of a car, An image pick- 
up means to picturize the side of a car and to output a picture signal, and a movement vector 
detection means to detect a movement vector for every field of the picturized image based on said 
picture signal under car transit, The spatial rate of change of the magnitude of said detected 
movement vector is distinguished, and it is characterized by having a distance calculation means to 
compute the distance to a road edge based on this rate of change and said passing speed. 
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[0028] According to this invention, while the passing speed of a car is detected by the sensor section 
of navigation equipment, the image pick-up by the image pick-up means is performed towards the 
car side, and a picture signal is outputted. And the image processing by the same operation as 
invention according to claim 1 is performed. Therefore, it can utilize effective in reservation of 
safety, or other various functions, and the computed distance can raise the safety and convenience of 
a car. 

[0029] In navigation equipment according to claim 12, navigation equipment according to claim 13 
is characterized by having further a notice means to notify of the car having approached the road 
edge, when said computed distance is smaller than the value set up beforehand. 
[0030] According to this invention, with navigation equipment, since it judges that the car 
approached the road edge too much based on the distance to a road edge and the driver was notified 
of that, the safety and convenience of a car can be raised further. 

[0031] Navigation equipment according to claim 14 is characterized by having further a width-of- 
road calculation means to compute the width of road of the transit road of a car in navigation 
equipment according to claim 12 or 13. 

[0032] When according to this invention the width of road of a transit road can be computed, for 
example, the image pick-up means is installed in the flank of car both sides by the car it runs, if two 
distance is applied and the width of face of a car is applied further, the width of road will be 
obtained. Therefore, it becomes useful to the improvement in functional of the security and 
navigation of a car to secure the insurance under transit, or to acquire width-of-road data, to relate 
with map data and to hold using this width of road, etc. 

[0033] Navigation equipment according to claim 15 is characterized by having further a width-of- 
road data storage means to relate the width-of-road data corresponding to said computed width of 
road with said map data, and to memorize them possible [ updating ] in navigation equipment 
according to claim 14. 

[0034] According to this invention, with the navigation equipment for mount, it memorizes possible 
[ updating of the width-of-road data corresponding to the width of road for which the width-of-road 
data storage means was asked as mentioned above ]. Therefore, since it can utilize when the width- 
of-road data of the road the car ran are held and it passes along the road same after that again, the 
function of navigation equipment is supportable. 

[0035] Navigation equipment according to claim 16 is characterized by having further a slow lane 
judging means to judge the slow lane of a car based on the calculation result of said distance 
calculation means and said width-of-road calculation means, and a lane notice means to notify of the 
proper lane should collate said judged slow lane with the optimal path to said destination, and it 
should run based on this collating result in navigation equipment according to claim 14 or 15. 
[0036] According to this invention, with navigation equipment, while a car runs the road of two or 
more lanes, the slow lane is judged based on the distance and the width of road to a road edge. And 
the judged lane is collated with an optimal path and notifies a driver of the proper lane it should run 
based on the result. Therefore, since it is made to run the lane corresponding to an optimal path, 
attention of a driver can be called, and a comfortable navigation function can be realized. 
[0037] the case where, as for said lane notice means, said judged slow lane does not agree into said 
proper lane in navigation equipment according to claim 1 6 in navigation equipment according to 
claim 17 — this ~ it is characterized by notifying of a proper lane. 

[0038] According to this invention, the judged lane is collated with an optimal path by the same 
operation as invention according to claim 16, and when it is judged that it is not running the lane 
where a car is proper, a driver is notified of a proper lane. Therefore, avoiding the unnecessary notice 
at the time of running the proper lane, a necessary minimum notice is performed and a comfortable 
navigation function can be realized. 

[0039] the case where, as for said lane notice means, said judged slow lane agrees into said proper 
lane in navigation equipment according to claim 16 in navigation equipment according to claim 18 ~ 
this -- it is characterized by notifying of agreeing into a proper lane. 

[0040] According to this invention, the judged lane is collated with an optimal path by the same 
operation as invention according to claim 1 6, and when [ at which it is running the lane where a car 
is proper ] judged, a driver is notified of that. Therefore, a driver is made to know running the proper 
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lane and the comfortable navigation function to give sense of security to a driver can be realized. 
[0041] 

[Embodiment of the Invention] Hereafter, the gestalt of suitable operation of this invention is 
explained based on a drawing. In the gestalt of the following operations, the case where it applies to 
the navigation equipment in which this invention is carried by the car is explained. 
[0042] Drawing 1 is drawing showing the outline configuration of the navigation equipment 
concerning this operation gestalt. The navigation equipment shown in drawing 1 is constituted 
including a control section 1 1, the map data storage section 12, the width-of-road data storage 
section 13, the sensor section 14, the current position detecting element 15, a display 16, a 
loudspeaker 17, the image-processing section 18, and CCD cameras 19a and 19b. 
[0043] In the above configuration, a control section 11 controls actuation of the whole navigation 
equipment. A control section 1 1 outputs and inputs data while it reads and performs the control 
program which consists of a CPU etc. and is stored in ROM which is not illustrated and sends out a 
control signal to each component of navigation equipment. 

[0044] The map data storage section 12 is memory with the big storage capacity which stores map 
data, for example, CD-ROM and DVD-ROM are used. The map data stored in the map data storage 
section 12 are constituted including road configuration data, name data, background data, etc. 
[0045] The width-of-road data storage section 13 is memory recorded possible [ updating of the 
width-of-road data under car transit obtained in connection with the image processing concerning 
this invention ]. Although simple width-of-road information is included also in the map data of the 
above-mentioned map data storage section 12, the width-of-road data memorized by the width-of- 
road data storage section 1 3 are still more detailed data, and are data which asked for the width of 
road which changes according to the location of a road correctly. In addition, about the generation 
method of width-of-road data, it mentions later. 

[0046] The sensor section 14 contains various sensors required in order to detect the current position 
of a car. Specifically, it is constituted including the speed sensor which detects the rate of a car, the 
bearing sensor which detects the bearing variation of a car, the GPS receive section which receives 
the electric wave from a GPS (Global Positioning System) satellite. 

[0047] Based on the output signal from the sensor section 14, the current position detecting element 
1 5 computes the current position of a car, and outputs current position data. In addition, current 
position data are collated with the above-mentioned map data by the control section 1 1 , and are 
amended by map matching processing etc. 

[0048] Under directions of a control section 11, while map data are displayed in various modes, it 
superimposes on this and the current position of a car is displayed on a display 1 6 as a car mark. This 
display 16 consists of CRT, a liquid crystal display component, etc. Moreover, from a loudspeaker 
17, while the induction information in alignment with the path of a car is outputted by voice, the 
below-mentioned guidance voice is outputted in relation to the image processing concerning this 
invention. 

[0049] The image-processing section 1 8 is a means to perform the image processing which analyzes 
the picture signal from two sets of CCD cameras 19a and 19b installed in a car, and starts this 
operation gestalt. Here, the configuration and actuation of the image-processing section 18 are 
explained using dra wing 2 . 

[0050] As shown in drawing 2 , the image-processing section 18 is constituted including A/D 
converter 21, the 1st image memory 22, the 2nd image memory 23, the movement vector detecting 
element 24, and the movement vector processing section 25. Moreover, the image control section 18 
operates according to the control signal from a control section 1 1 . In addition, although the image- 
processing section 18 processes the picture signal from two sets of CCD cameras 19a and 19b like 
the after-mentioned in fact, since it is easy, it explains the case where the picture signal from one 
CCD cameral9a is processed. 

[0051] In drawing. 2 , A/D converter 21 changes into a digital image signal the analog picture signal 
based on the image picturized by CCD camera 19a. Usually, the digital image signal outputted from 
A/D converter 21 constitutes one frame image data for every predetermined frame period, and 
consists of two or more continuous frame image data. 

[0052] The 1st image memory 22 and the 2nd image memory 23 store the frame image data 
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outputted from A/D converter 21, respectively. The 1st image memory 22 stores the newest frame 
image data, and the 2nd image memory 23 stores the frame image data in front of one. Therefore, in 
the image-processing section 1 8, the newest image data for two frames is always held, and the 
below-mentioned processing is performed using these. 

[0053] The movement vector detecting element 24 detects the movement vector for every field in an 
image based on the frame image data stored in the 1 st image memory 22 and the 2nd image memory 

23. Under the present circumstances, the vehicle speed data outputted from the sensor section 14 are 
used. 

[0054] Moreover, based on the movement vector detected by the movement vector detecting element 

24, the movement vector processing section 25 asks for the distance to the road edge in a transit 
road, and the width of road based on this, and outputs them as width-of-road data etc. 

[0055] In addition, about the detail of the processing in the movement vector detecting element 24 
and the movement vector processing section 25, it mentions later. 

[0056] Returning to drawing 1 , CCD cameras 19a and 19b are installed near the both ends ahead of 
a car, respectively, picturize the right-and-left side of a car, and output a picture signal. The 
installation condition to the car of CCD cameras 19a and 19b is shown in drawing 3 here. 
[0057] Drawing 3 (a) is drawing showing the installation condition of CCD cameras 19a and 19b 
seen from the car upper part. As shown in drawing 3 (a), CCD cameras 19a and 19b are attached in 
the car-body upper part of right-and-left both sides at the car front side. CCD camera 19a is attached 
in car left-hand side, and CCD camera 19b is attached in car right-hand side, respectively. CCD 
camera 19a turns to the side on the left-hand side of a car, and is attached possible [ an image pick- 
up ], and CCD camera 19b turns to the side on the right-hand side of a car, is attached possible [ an 
image pick-up ], and is installed by respectively symmetrical arrangement. 

[0058] Moreover, drawing. 3 (b) is drawing showing the installation condition seen from the car front 
with the image pick-up range about CCD camera 19a. In addition, since it is easy, only the image 
pick-up condition in the case of on the left-hand side of a car is shown. As shown in drawing 3 (b), 
CCD camera 19a picturizes the range of the field angle theta toward a wall surface. Usually, it is 
attached in the include angle at which a path road surface is reflected in the lower part while a upside 
wall surface is reflected in the picturized image. In this invention, the distance DL to a left-hand side 
road edge is computed based on the image picturized by CCD camera 1 9a. 

[0059] In addition, CCD camera 19a is attached in a location with a height [ of a car ] of about lm. 
Moreover, in right-hand side CCD camera 19b, it will be in drawing 3 (b) and a symmetrical image 
pick-up condition, and it will compute the distance DR to a right-hand side road edge. 
[0060] Next, the principle of the image processing concerning this operation gestalt is explained with 
reference to drawing^ - drawing 8 . 

[0061] Drawing 4 is drawing which expressed the image picturized by above-mentioned CCD 
cameras 19a and 19b with the model of a pinhole camera. In draw ing 4 , the image plane P0 
corresponding to the photo detector section of CCD camera 19a and the focal plane F corresponding 
to the lens section separate a focal distance f, and are arranged in parallel. The lens core C of a focal 
plane F corresponds to a pinhole, and considers a space-coordinates system (X, Y, Z) centering on 
this lens core C. On the other hand, by the image plane P0, camera system of coordinates (x y) are 
considered by setting space coordinates (0, 0, -f) as the image core c. 

[0062] Here, the point M of a space-coordinates system (Xm, Ym, Zm) is considered. This point M 
can be made to correspond to the position on the wall surface in drawing 3 (b). Considering the 
central projection over this point M, even an image plane P0 is connected in a straight line through 
the lens core C of a focal plane F from Point M, and it is projected on the point m of camera system 
of coordinates (xm, ym). At this time, the relation between Point M (Xm, Ym, Zm) and the projected 
point m (xm, ym) is expressed with a degree type. 
[0063] 

[Equation 1] xm = f-Xm/Zmym = It is drawing where draw ing 5 expressed the relation between a 
space-coordinates system (X, Y, Z) and the pixel system of coordinates (u, v) of image data to the f- 
Ym/Zm order corresponding to drawing^ . Since it is easy, while arranging the image plane P0 of 
drawing 4 to the front side of a focal plane F in drawing 5 , it considers as a pixel image system (u, 
v) by reversing the x axis of camera system of coordinates (x y), and the y-axis, respectively, and 
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considering as u shaft and v shaft. Even if it transposes arrangement of drawing 4 to arrangement of 
drawing__5 , since it is mutually equivalent, the same relation is realized. 

[0064] In d rawin g 5 , the image plane PI of a pixel image system supports the display image of the 
horizontal number Nw of pixels, and the vertical number Nh of pixels, and the pixel of NwxNh is 
contained in an image plane PI in all. On the other hand, this image plane PI is in agreement with 
the light-receiving field of CCD cameras 19a and 19b with which size is set to Breadth w and height 
h. And if the point M of a space-coordinates system (X, Y, Z) is considered like drawing 4 , as 
shown in drawing 5 , it will be connected in a straight line to the lens core C of a focal plane F 
through the point m of an image plane PI (u, v). 

[0065] Here, considering the central projection over Point m, corresponding to several 1, the relation 
between Point M (X, Y, Z) and the projected point m (u, v) is expressed with a degree type like 
drawing, 4 . 
[0066] 

[Equation 2] u = (f-X/Z) -Nw/wv = (f-Y/Z) -Nh/h, several 2 [ i.e., ], expresses the pixel location in 
the image plane PI of Point m (u, v). In several 2, u corresponds to a horizontal pixel location and v 
supports the vertical pixel location. 

[0067] With this operation gestalt, since the image picturized from the car under transit is processed, 
it is necessary to assume a motion of the body in an image plane PL Therefore, it is necessary to ask 
for the optical flow in an image plane PI, i.e., movement vector V, (u, v). When brightness I of the 
same point of three-dimension space is kept constant, the following differential equation between 
space-time is realized. 
[0068] 
[Equation 3] 

dl/dt = Ix-u+Iy-v+It = It corrects zero and a partial differential with horizontal Ix and Iy are [ a 
vertical partial differential and It of the partial differential of time amount shaft orientations, and u 
and v ] the components of horizontal [ of above-mentioned movement vector V ], and a 
perpendicular direction in an image plane PI, respectively. 

[0069] Next, how to ask for movement vector V using drawing 6 and drawin g 7 is explained. As 
shown in d rawing 6 , reference block R is defined in the image plane PI in time of day L With the 
upper left pixel pr as the starting point, this reference block R is the rectangle field of the range of n 
pixels, and contains the pixel of a mxn individual in u shaft in all at m pixels and v shaft. And an 
image plane PI is divided into two or more reference block R, and each reference block R of every is 
asked for movement vector V. The example of drawing 6 shows reference block R used as m= 8 and 
n=8. 

[0070] Drawing 7 is drawing explaining how to ask for movement vector V to predetermined 
reference block R in an image plane PI . Drawing 7 corresponds to the image plane PI in time-of-day 
t+delta t in which deltat has passed since the time of day t of drawing 6 . And based on the vehicle 
speed data from the sensor section 14 etc., the predetermined field in an image plane PI is 
beforehand appointed as search range S. The search range S is a rectangle field where it becomes M 
pixels on u shaft, and it becomes v shaft with N pixel, and M and N usually become sufficiently 
large compared with m and n. 

[0071] And the comparison block C of reference block R and the same size is defined as a position 
to the search range S. Since size is sufficiently large compared with reference block R, it is 
necessary, as for the search range S, to move the location of the comparison block C little by little in 
the search range S. By drawing 7 , the comparison block C is the size of mxn like reference block R, 
and shows the pixel pc at the upper left of the comparison block C corresponding to the pixel pr at 
the upper left of a reference block. The pixel at the upper left of the search range S is set as the pixel 
pc of the comparison block C at first, after that, in the search range S, it moves 1 pixel of locations of 
Pixel pc at a time to u shaft orientations or v shaft orientations, and the below-mentioned operation is 
performed about all comparison blocks C that can be defined in the search range S. 
[0072] Subsequently, a* correlation value is calculated between the comparison blocks C in reference 
block R in the time of day t of drawing 6 , and time-of-day t+delta t of drawing 7 . Here, in the image 
data which is the set of a pixel, since the concentration value is made to correspond to all the pixels 
of a mxn individual, it asks for the difference of the concentration value for every pixel to which 
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reference block R and the comparison block C correspond. A correlation value is calculable if the 
sum about the pixel of a mxn individual is taken to the difference for every pixel of this 
concentration value. 

[0073] And to reference block R, the correlation value during all comparison blocks C in the search 
range S is calculated, and it searches for the comparison block C which gives the minimum 
correlation value. For example, the comparison block C shown in drawing. 7 presupposes that the 
minimum correlation value is given. 

[0074] In this case, as shown in drawing 7 , in an image plane PI, the vector which tends toward the 
comparison block C in time-of-day t+delta t from reference block R in the time of day t shown by 
the dotted line can be determined as movement vector V. 

[0075] Although drawing 7 showed only one movement vector V, it asks for movement vector V in 
fact about all reference block R which can be defined as an image plane PI . This searches for spatial 
distribution of movement vector V. And the below-mentioned processing is performed based on 
spatial distribution of this movement vector V. 

[0076] Next, the above-mentioned distance DR and DL and the calculation approach of the width of 
road are explained using drawing 8 . Drawing 8 is drawing showing an example of distribution of 
movement vector V in the image picturized from CCD cameral9a. In d rawing 8 , since it is easy, in 
the longitudinal direction of a car, the case where the path road surface and the wall surface have 
touched in the boundary section 30 is assumed like drawing 3 (b). Moreover, distribution of 
movement vector V on Rhine LI in time of day t is considered. 

[0077] As shown in drawing 8 , in the image picturized in CCD camera 19a, the magnitude of 
movement vector V is changing with the rate of change of abbreviation regularity by the path road 
surface in the lower part of the boundary section 30 to the magnitude of movement vector V serving 
as constant value on the wall surface in the upper part of the boundary section 30. Thus, the 
magnitude of movement vector V serves as a value depending on the distance z to a photography 
object. 

[0078] That is, supposing it performs the image pick-up by CCD camera 19a by frame period T in 
the car it is running at a rate vO (m/second), the migration length d of a 1 inter-frame car is [0079]. 
[Equation 4] d = vOandT (m) 

It can express. Here, if a photography object considers the situation which does not change only in 
the direction of u in a motion, the direction of v, and the direction of z relatively [ car ], the following 
formulas will be realized that what is necessary is several 2 just to substitute above-mentioned x=d. 
[0080] 

[Equation 5] u = (f-d/z) -Nw/w = (f-vO.T/z) It can express -Nw/w. Movement vector V (u, 0) 
becomes settled by u shown in several 5, and this u is in agreement with the magnitude of movement 
vector V. Thus, the magnitude of movement vector V is in inverse proportion to the distance z with a 
photography object. 

[0081] Drawing 9 is drawing in which the magnitude of movement vector V of Rhine LI shows 
signs that it changes corresponding to several 5. In drawing 9 , while a continuous line shows the 
magnitude of the movement vector of a photography object to v shaft in the image of drawing 8 , the 
dotted line shows distance z. Since distance z becomes fixed, on a wall surface, it becomes fixed 
[ the magnitude of movement vector V ], so that drawing 8 may show. On the other hand, since it 
becomes small at a rate of abbreviation regularity so that distance z goes by the path road surface 
caudad, several 5 u becomes large linearly. 

[0082] Therefore, in drawing 9 , movement vector V cannot change with the rate of change of 
abbreviation regularity, but can distinguish a wall surface and a path road surface based on whether 
it becomes in general fixed, and can also judge the location of the boundary section 30. And MV 
(pixel), then the distance DL to the above-mentioned wall surface are based on several 5 in the 
average of movement vector V of a wall surface, and it is [0083]. 
[Equation 6] 

DL = (f-vO.TYMV) -Nw/w can be computed and calculated. 

[0084] In addition, although movement vector V becomes small with the rate of change of 
abbreviation regularity as it goes above an image by the path road surface when a slot exists in a 
road edge, on the boundary of a path road surface and a slot, it changes uniformly [ rate of change ] 
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and rapidly partially. Therefore, a slot can be detected by distinguishing this break point, and the 
distance DL to a road edge can be found based on the magnitude of movement vector V before and 
behind that. 

[0085] Moreover, what is necessary is to generate two or more fields where movement vector V 
becomes in general fixed, when becoming a partial wall surface like the guard rail instead of a single 
wall surface, but just to use the distance DL which finds the distance DL about two or more fields, 
among those serves as the shortest, while detecting a break point as mentioned above. Also when a 
guard rail adjoins a road edge, the distance DL of a road edge can be found based on the distance to 
the field corresponding to a guard rail. 

[0086] In addition, as an example of each numeric value in several 5, it becomes focal distance f= 4 
(mm), horizontal pixel number Nw=320 (pixel), and breadth [ of a light-receiving field ] w=4(mm) 
frame period T=l / 30 (second) extent. . 

[0087] If the above image processing is similarly performed to the image by two CCD cameras 19a 
and 19b, the distance DL and DR to the road edge in right and left of a car will be found. Therefore, 
while adding these, in consideration of the breadth of a car, the width of road in the road under 
transit is further computable. For example, when a car has Breadth W in the installation condition of 
drawing 2 (b), the width of road RW is [0088]. 
[Equation 7] RW ** It can ask in approximation with DL+DR+W. 

[0089] In addition, if the width-of-road data corresponding to the computed width of road RW are 
related with map data and memorized possible [ updating ] in the width-of-road data storage section 
13, it can use for various kinds of below-mentioned processings. 

[0090] Next, the concrete image processing in the navigation equipment concerning this operation 
gestalt is explained with reference to drawing 10 and drawin g 1 1 . Drawing 10 is a flow chart which 
shows processing for the car under transit to prevent approaching a road edge, and drawing 1 1 is a 
flow chart which shows processing for the car under transit the road of two or more lanes to make it 
run a proper lane to a setting path. In addition, drawing 10 and drawing 1 1 are processings mainly 
performed according to control of a control section 1 1 . 

[0091] If the processing shown in drawing 10 is started, the distance DL and DR to the road edge of 
both sides will be found, and the width of road RW will be computed by processing of the above 
image-processing sections 18 according to several 7 based on this (step SI). And the width-of-road 
data corresponding to the width of road RW computed at step SI are related with map data, and are 
written in the width-of-road data storage section 13 (step S2). At this time, it may be made to write 
in width-of-road data in the predetermined point path on the street set up beforehand. 
[0092] Subsequently, based on the distance DL and DR acquired in step SI, it is judged whether the 
car under transit visits a road edge too much (step S3), namely, what is necessary is to set up a 
predetermined distance used as criteria, and just to judge that a car visits a road edge too much and 
comes out to it, when distance DL or DR serves as a small value from this predetermined distance 
[0093] When the decision result of step S3 is "YES", a car visits a road edge too much, and comes 
out to it, and it warns a driver of a certain thing (step S4). For example, what is necessary is just to 
output as voice the predetermined message which visits a road edge too much, comes out to it, and 
shows a certain purport from a loudspeaker 17. Or the same message or a display notation may be 
displayed on a display 16. 

[0094] After finishing step S4 when the decision result of step S3 is "NO" or, it judges whether a car 
is running or not (step S5). When a car is not running (step S5; NO), since it is not necessary to 
perform an image processing, processing is finished. On the other hand, when a car is still running 
(step S5; YES), processing of step SI - step S5 is repeated. 

[0095] In navigation equipment, real time can be asked for the always exact width of road RW by 
processing the above step SI - step S5. And since it was made to warn a driver when the distance DL 
and DR to a road edge was supervised and the car under transit visited a road edge too much, 
operation of a driver can be assisted and the insurance under transit can be secured. Moreover, since 
width-of-road data were suitably written in the width-of-road data storage section 13, when running 
the behind same road, it becomes possible to utilize width-of-road data effectively. 
[0096] Next, the desired destination is set as navigation equipment and processing shown in drawing 
1 1 is performed under the situation that a path is judged. First, like step SI, the distance DL and DR 
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to the road edge of both sides is found, and the width of road RW is computed further (step SI 1). 
[0097] And the lane information over the lane under transit included in the map data of the map data 
storage section 12 is read (step S12). Since the road under transit is the information which shows 
**** w ith what lane, this lane information judges whether the roads under transit are two or more 
lanes based on lane information (step SI 3). 

[0098] When the decision result of step S13 is "YES", based on the decision result of step SI 1, it 
judges which lane is under transit among two or more lanes now (step S14). This judgment can be 
performed based on a ratio with the distance DL and DR to the road edge of the both sides of the car 
for which it asked at step S 1 . 

[0099] Then, the lane judged at step S 14 judges whether it is a proper lane corresponding to the path 
which arrives at the destination (step SI 5). That is, if the case where it is running the road of three 
lanes, for example is taken for an example, you may be which lane when a right-hand side lane 
becomes proper when turning to the right ahead generally, a left-hand side lane serves as fitness 
when turning left ahead, and going straight on as it is. Or the information on the proper lane at the 
time of left turn and right-turn may be set up beforehand. 

[0100] As a result of the judgment of step SI 5, when the car is running the proper lane, processing 
(step SI 5; YES) is finished. On the other hand, when the car is running the lane which is not proper, 
guidance of lane modification is directed to (step SI 5; NO) and a driver (step SI 6). for example, the 
case where it is running the left-hand side lane before the right-turn point — already — what is 
necessary is to output as voice the message of a purport which urges moving to 2 lane right to a 
driver from a loudspeaker 17, or just to display it on a display 16 

[0101] In navigation equipment, the lane in which a car is located by the road of two or more lanes 
can be judged on real time by processing the above step SI 1 - step SI 6. And unnecessary guidance 
does not need to be performed, when guidance is performed only when required and it has already 
run the proper lane, since it was made to guide lane modification to a driver only when it was not 
located in a proper lane, in order to perform right-turn, left turn, etc. Therefore, convenience is high 
and much more comfortable navigation becomes realizable for a driver. 

[0102] In addition, in the example of drawing 1 1 , only while the car is running the lane which is not 
proper, when directing guidance of lane modification, namely, while running the proper lane, the 
case where guidance of lane modification was not directed was explained, but it is not restricted to 
this, but while [ when a car is proper ] running, it may be made to perform a certain guidance. For 
example, while running a proper lane, guidance of "please maintain the lane of this as" may be 
outputted with voice etc. Thereby, the driver under operation can be made to be able to grasp 
running the proper lane, and sense of security can be given to it. 

[0103] As mentioned above, although this invention was explained based on the operation gestalt, 
this invention is not limited to the above-mentioned operation gestalt at all, and it can guess it easily 
for amelioration deformation various by within the limits which does not deviate from the meaning 
of this invention to be possible. 

[0104] For example, you may make it display the image picturized with CCD cameras 19a and 19b 
as an image pick-up means on a display 16. With this operation gestalt, since it is installed so that 
CCD cameras 19a and 19b may picturize the just beside direction in the car front, before a driver 
arrives at the location which can see the side directly, on a display 16, a side image is checked by 
looking and the thing of it can be carried out. Especially when a car advances into a crossing from a 
narrow alley, a side image can be checked by looking only by taking out a car tip to a crossing 
slightly, and it becomes useful at insurance transit of a car. 

[0105] Moreover, although the above-mentioned operation gestalt explained the case where it was 
installed so that CCD cameras 19a and 19b as an image pick-up means may picturize the just beside 
direction in the side of a car, it is not restricted to this, but you may install so that the direction of 
before [ slant ] approach in the side of a car may be picturized. Thereby, a side image can be 
preceded in time, and can be processed and the distance to a road edge can be found timely. 
[0106] Or you may install so that the direction [ in / for CCD cameras 19a and 19b / the side of a 
car ] of the bottom approach of slant may be picturized. Generally, if CCD cameras 19a and 19b with 
a vertical narrow field angle are used, when a car approaches a road edge, the case where a road edge 
stops entering in an image will arise, in such a case, since it comes out, and a road edge will enter in 
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an image if the image pick-up direction of CCD cameras 19a and 19b comes together the bottom and 
there comes out and is even if it is, it becomes possible to find the distance to a road edge. 
[0107] Moreover, CCD cameras 19a and 19b which have a larger field angle may be used. For 
example, when a horizontal field angle performs above-mentioned processing separately to the left- 
hand side field and the right-hand side field in each image pick-up image using some CCD cameras 
19a and 19b about 180 degrees, the distance to a road edge may be found. The distance to a road 
edge can be found thereby still more finely. 
[0108] 

[Effect of the Invention] Since according to this invention the side of the car under transit is 
picturized with an image pick-up means, an image processing is performed and the distance to a road 
edge was found as explained above, the security of a transit car, acquisition of width-of-road data, 
etc. become possible [ raising the safety and convenience of a car ]. 

[0109] Moreover, if this invention is applied to navigation equipment, it will become possible to 
support navigation equipment and to aim at improvement in functional by the notice to the driver at 
the time of road edge contiguity of a car, the notice of lane modification based on a lane judging, a 
width-of-road data storage, etc. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI axe not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s h ows the word which can not be translated. 
3. In the drawings, any words are not translated. 



TECHNICAL FIELD 



[Field of the Invention] This invention belongs to the technical field of the image processing system 
and the image-processing approach of asking for the distance and the width of road to a road edge 
based on the picture signal from an image pick-up means, and navigation equipment in the car under 
transit. 
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PRIOR ART 



[Description of the Prior Art] The navigation equipment which displays the current position which 
detected the current position of the car as a mobile and was detected with the surrounding road map 
from the former on a display screen, and performs path guidance is used widely. In this kind of 
navigation equipment, it has the mass record medium with which map data were memorized, and it 
is used in order to generate the indicative data on a display screen. In addition to data, various data 
for a display, etc. about a road configuration, the width-of-road information which accompanies this 
is included in the map data on a record medium. Therefore, the width-of-road information 
corresponding to the road under transit can be read, and the width of road of the road it is running 
now can be grasped. 
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EFFECT OF THE INVENTION 



[Effect of the Invention] Since according to this invention the side of the car under transit is 
picturized with an image pick-up means, an image processing is performed and the distance to a road 
edge was found as explained above, the security of a transit car, acquisition of width-of-road data, 
etc. become possible [ raising the safety and convenience of a car ]. 

[0109] Moreover, if this invention is applied to navigation equipment, it will become possible to 
support navigation equipment and to aim at improvement in functional by the notice to the driver at 
the time of road edge contiguity of a car, the notice of lane modification based on a lane judging, a 
width-of-road data storage, etc. 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] However, with the above-mentioned conventional 
navigation equipment, the width-of-road information included in map data does not show the exact 
width of road, and showed the width of road of the outline of the road like 5.5m-8m with it. 
Therefore, the fine exact width-of-road information corresponding to the point of a road was 
unacquirable. Furthermore, it not only gets to know the width of road of a road, but it asks real time 
for the distance to a road, and the needs for using this for insurance transit of a car are strong. 
[0004] Then, this invention is made in view of such a problem. The purpose is offering the 
navigation equipment which can perform warning and the guidance for securing insurance transit to 
a driver according to the result of the image processing system for mount which can ask for the 
distance and the width of road to a road edge , and an image processing by detecting the structures 
other than the path road surface which adjoins a wall surface , and a slot or a path road surface out of 
an image based on the image picturized from the car under transit . 
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MEANS 



[Means for Solving the Problem] In order to solve the above-mentioned technical problem, an image 
processing system according to claim 1 An image pick-up means to picturize the side of a mobile 
and to output a picture signal, and a movement vector detection means to detect a movement vector 
for every field of the picturized image based on said picture signal which a mobile is moving, The 
spatial rate of change of the magnitude of said detected movement vector is distinguished, and it is 
characterized by having a distance calculation means to compute the distance to a road edge based 
on this rate of change. 

[0006] According to this invention, with an image processing system, in mobiles, such as a car under 
transit, the image pick-up by the image pick-up means is performed towards the side, and a picture 
signal is outputted. This picture signal is compared at the two times, and the movement vector for 
every field is detected. Although the rate of change of a movement vector serves as abbreviation 
regularity in parts for a horizontal level, such as a path road surface in an image, the break point of 
rate of change arises at a road edge. Therefore, it can distinguish for every fields of these, a road 
edge can be distinguished, and the distance to a road edge can be further computed based on the 
magnitude of a movement vector. Therefore, the computed distance is available for applications, 
such as security under transit, and exchange of navigation, and can raise the safety and convenience 
of a car. 

[0007] Said distance calculation means is characterized by computing the 1st distance to a left-hand 
side road edge, and the 2nd distance to a right-hand side road edge including 1st image pick-up 
means by which, as for said image pick-up means, an image processing system according to claim 2 
picturizes the left-hand side side of a mobile in an image processing system according to claim 1 , 
and the 2nd image pick-up means which picturizes the right-hand side side of a mobile. 
[0008] Towards left-hand side, towards right-hand side, the 2nd image pick-up means picturizes, 
respectively, and, according to this invention, the 1st image pick-up means outputs a picture signal 
by mobiles, such as a car under transit. Like invention according to claim 1 , subsequent processing is 
performed about a right-hand side image and a left-hand side image, and can compute the distance to 
the both-sides road edge of a mobile. Therefore, two computed distance is acquired, and grasp of the 
car location in a transit road becomes easy, and can raise the safety and convenience of a car further. 
[0009] An image processing system according to claim 3 is characterized by having further a width- 
of-road calculation means to compute the width of road of the transit road of a mobile, based on said 
the 1st distance and said 2nd distance in an image processing system according to claim 2. 
[0010] According to this invention, based on two distance computed corresponding to the image of 
the right and left in mobiles, such as a car, the width of road of a transit road is computable. For 
example, when the image pick-up means is installed in the flank of car both sides, if two distance is 
applied and the distance between image pick-up means is applied further, the width of road will be 
obtained. Therefore, using this width of road, the insurance under transit is secured or it becomes 
useful to the improvement in functional of the security and navigation of a car, such as acquiring 
width-of-road data. 

[001 1] Said picture signal is constituted considering the frame image data in which an image 
processing system according to claim 4 has a predetermined frame period in an image processing 
system given in either of claim 1 to claims 3 as a unit, and said movement vector detection means is 
characterized by detecting said movement vector based on two continuous frame image data. 
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[0012] According to this invention, the object of an image processing is frame image data outputted 
for every frame period, and an above-mentioned image processing is performed using two 
continuous frame image data. Therefore, an image processing is always carried out to real time 
during transit of a car, and the image processing system which can respond to the situation of a car 
promptly can be realized. 

[0013] An image processing system according to claim 5 is characterized by being installed in a 
before [ a mobile ] side by said image pick-up means in an image processing system given in either 
of claim 1 to claims 4. 

[0014] displaying the picture signal from the image pick-up means installed in the before [ a mobile ] 
side on the display screen according to this invention — the above-mentioned operation — in addition, 
a check by looking usually checks easily the longitudinal direction by the side of before [ difficult ] a 
mobile by looking — things can be carried out and it becomes much more useful at the security of a 
car. 

[0015] An image processing system according to claim 6 is characterized by said image pick-up 
means picturizing the side of the approach before slant of a mobile in an image processing system 
given in either of claim 1 to claims 5 . 

[0016] Since it was made to perform above-mentioned processing based on the picture signal from 
an image pick-up means to picturize the approach before slant of a mobile according to this 
invention, the distance to the road edge in the travelling direction front of a car can be computed by 
preceding it in time, and the run state of a car can be grasped quickly. 

[0017] An image processing system according to claim 7 is characterized by said image pick-up 
means picturizing the side of the bottom approach of slant of a mobile in an image processing system 
given in either of claim 1 to claims 6. 

[0018] Since it was made to perform above-mentioned processing based on the picture signal from 
an image pick-up means to picturize the bottom approach of slant of a mobile according to this 
invention, even if it is the case where a road edge is approached, into a field angle, it becomes easy 
to catch a road edge and the safety of a transit car can be raised further. 

[0019] The image-processing approach according to claim 8 is the image-processing approach of 
performing an image processing based on the picture signal outputted from an image pick-up means 
to picturize the side of a mobile. The movement vector detection process of detecting a movement 
vector for every field of the picturized image based on said picture signal which a mobile is moving, 
The spatial rate of change of the magnitude of said detected movement vector is distinguished, and it 
is characterized by having the distance calculation process which computes the distance to a road 
edge based on this rate of change. 

[0020] According to this invention, the picture signal from the image pick-up means installed in 
mobiles, such as a car under transit, is inputted, according to the same operation as invention 
according to claim 1, a road edge can be distinguished and the distance to a road edge can be further 
computed based on the magnitude of a movement vector. Therefore, the computed distance is 
available for applications, such as security under transit, and exchange of navigation, and can raise 
the safety and convenience of a car. 

[0021] The image-processing approach according to claim 9 is outputted for said picture signal in the 
image-processing approach according to claim 8, respectively from the 1st image pick-up means 
which picturizes the left-hand side side of a mobile, and the 2nd image pick-up means which 
picturizes the right-hand side side of a mobile, and said distance calculation process is characterized 
by computing the 1 st distance to a left-hand side road edge, and the 2nd distance to a right-hand side 
road edge. 

[0022] According to this invention, the picture signal corresponding to the left-hand side side from 
the 1st image pick-up means installed in mobiles, such as a car under transit, and the picture signal 
corresponding to the right-hand side side from the 2nd image pick-up means are inputted, 
respectively, and the distance to the both-sides road edge of a mobile can be computed according to 
the same operation as invention according to claim 2, Therefore, two computed distance is acquired, 
and grasp of the car location in a transit road becomes easy, and can raise the safety and convenience 
of a car further. 

[0023] The image-processing approach according to claim 10 is characterized by having further the 
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width-of-road calculation process which computes the width of road of the transit road of a mobile 
based on said the 1st distance and said 2nd distance in the image-processing approach according to 
claim 9. 

[0024] According to this invention, it becomes useful to the improvement in functional of the 
security and navigation of a car, such as the width of road of a transit road being computable, and 
securing the insurance under transit or acquiring width-of-road data using this width of road, 
according to the same operation as invention according to claim 3. 

[0025] Said picture signal is constituted considering the frame image data in which the image- 
processing approach according to claim 1 1 has a predetermined frame period in the image- 
processing approach given in either of claim 8 to claims 10 as a unit, and said movement vector 
detection process is characterized by detecting said movement vector based on two continuous frame 
image data. 

[0026] Since an above-mentioned image processing is performed by the same operation as invention 
according to claim 4 using two continuous frame image data according to this invention, an image 
processing is always carried out to real time during transit of a car, and the image-processing 
approach which can respond to the situation of a car promptly can be offered. 
[0027] The sensor section which navigation equipment according to claim 12 is navigation 
equipment which performs path guidance from the current position of a car to the destination based 
on map data, and contains the speed sensor which detects the passing speed of a car, An image pick- 
up means to picturize the side of a car and to output a picture signal, and a movement vector 
detection means to detect a movement vector for every field of the picturized image based on said 
picture signal under car transit, The spatial rate of change of the magnitude of said detected 
movement vector is distinguished, and it is characterized by having a distance calculation means to 
compute the distance to a road edge based on this rate of change and said passing speed. 
[0028] According to this invention, while the passing speed of a car is detected by the sensor section 
of navigation equipment, the image pick-up by the image pick-up means is performed towards the 
car side, and a picture signal is outputted. And the image processing by the same operation as 
invention according to claim 1 is performed. Therefore, it can utilize effective in reservation of 
safety, or other various functions, and the computed distance can raise the safety and convenience of 
a car. 

[0029] In navigation equipment according to claim 12, navigation equipment according to claim 13 
is characterized by having further a notice means to notify of the car having approached the road 
edge, when said computed distance is smaller than the value set up beforehand. 
[0030] According to this invention, with navigation equipment, since it judges that the car 
approached the road edge too much based on the distance to a road edge and the driver was notified 
of that, the safety and convenience of a car can be raised further. 

[0031] Navigation equipment according to claim 14 is characterized by having further a width-of- 
road calculation means to compute the width of road of the transit road of a car in navigation 
equipment according to claim 12 or 13. 

[0032] When according to this invention the width of road of a transit road can be computed, for 
example, the image pick-up means is installed in the flank of car both sides by the car it runs, if two 
distance is applied and the width of face of a car is applied further, the width of road will be 
obtained. Therefore, it becomes useful to the improvement in functional of the security and 
navigation of a car to secure the insurance under transit, or to acquire width-of-road data, to relate 
with map data and to hold using this width of road, etc. 

[0033] Navigation equipment according to claim 15 is characterized by having further a width-of- 
road data storage means to relate the width-of-road data corresponding to said computed width of 
road with said map data, and to memorize them possible [ updating ] in navigation equipment 
according to claim 14. 

[0034] According to this invention, with the navigation equipment for mount, it memorizes possible 
[ updating of the width-of-road data corresponding to the width of road for which the width-of-road 
data storage means was asked as mentioned above ]. Therefore, since it can utilize when the width- 
of-road data of the road the car ran are held and it passes along the road same after that again, the 
function of navigation equipment is supportable. 
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[0035] Navigation equipment according to claim 16 is characterized by having further a slow lane 
judging means to judge the slow lane of a car based on the calculation result of said distance 
calculation means and said width-of-road calculation means, and a lane notice means to notify of the 
proper lane should collate said judged slow lane with the optimal path to said destination, and it 
should run based on this collating result in navigation equipment according to claim 14 or 15. 
[0036] According to this invention, with navigation equipment, while a car runs the road of two or 
more lanes, the slow lane is judged based on the distance and the width of road to a road edge. And 
the judged lane is collated with an optimal path and notifies a driver of the proper lane it should run 
based on the result. Therefore, since it is made to run the lane corresponding to an optimal path, 
attention of a driver can be called, and a comfortable navigation function can be realized. 
[0037] the case where, as for said lane notice means, said judged slow lane does not agree into said 
proper lane in navigation equipment according to claim 16 in navigation equipment according to 
claim 17 — this ~ it is characterized by notifying of a proper lane. 

[0038] According to this invention, the judged lane is collated with an optimal path by the same 
operation as invention according to claim 16, and when it is judged that it is not running the lane 
where a car is proper, a driver is notified of a proper lane. Therefore, avoiding the unnecessary notice 
at the time of running the proper lane, a necessary minimum notice is performed and a comfortable 
navigation function can be realized. 

[0039] the case where, as for said lane notice means, said judged slow lane agrees into said proper 
lane in navigation equipment according to claim 16 in navigation equipment according to claim 18 -- 
this ~ it is characterized by notifying of agreeing into a proper lane. 

[0040] According to this invention, the judged lane is collated with an optimal path by the same 
operation as invention according to claim 1 6, and when [ at which it is running the lane where a car 
is proper ] judged, a driver is notified of that. Therefore, a driver is made to know running the proper 
lane and the comfortable navigation function to give sense of security to a driver can be realized. 
[0041] 

[Embodiment of the Invention] Hereafter, the gestalt of suitable operation of this invention is 
explained based on a drawing. In the gestalt of the following operations, the case where it applies to 
the navigation equipment in which this invention is carried by the car is explained. 
[0042] Drawing 1 is drawing showing the outline configuration of the navigation equipment 
concerning this operation gestalt. The navigation equipment shown in drawing 1 is constituted 
including a control section 11, the map data storage section 12, the width-of-road data storage 
section 13, the sensor section 14, the current position detecting element 15, a display 16, a 
loudspeaker 17, the image-processing section 18, and CCD cameras 19a and 19b. 
[0043] In the above configuration, a control section 1 1 controls actuation of the whole navigation 
equipment. A control section 1 1 outputs and inputs data while it reads and performs the control 
program which consists of a CPU etc. and is stored in ROM which is not illustrated and sends out a 
control signal to each component of navigation equipment. 

[0044] The map data storage section 12 is memory with the big storage capacity which stores map 
data, for example, CD-ROM and DVD-ROM are used. The map data stored in the map data storage 
section 12 are constituted including road configuration data, name data, background data, etc. 
[0045] The width-of-road data storage section 13 is memory recorded possible [ updating of the 
width-of-road data under car transit obtained in connection with the image processing concerning 
this invention ]. Although simple width-of-road information is included also in the map data of the 
above-mentioned map data storage section 12, the width-of-road data memorized by the width-of- 
road data storage section 1 3 are still more detailed data, and are data which asked for the width of 
road which changes according to the location of a road correctly. In addition, about the generation 
method of width-of-road data, it mentions later. 

[0046] The sensor section 14 contains various sensors required in order to detect the current position 
of a car. Specifically, it is constituted including the speed sensor which detects the rate of a car, the 
bearing sensor which detects the bearing variation of a car, the GPS receive section which receives 
the electric wave from a GPS (Global Positioning System) satellite. 

[0047] Based on the output signal from the sensor section 14, the current position detecting element 
15 computes the current position of a car, and outputs current position data. In addition, current 
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position data are collated with the above-mentioned map data by the control section 11, and are 
amended by map matching processing etc. 

[0048] Under directions of a control section 1 1 , while map data are displayed in various modes, it 
superimposes on this and the current position of a car is displayed on a display 1 6 as a car mark. This 
display 16 consists of CRT, a liquid crystal display component, etc. Moreover, from a loudspeaker 
17, while the induction information in alignment with the path of a car is outputted by voice, the 
below-mentioned guidance voice is outputted in relation to the image processing concerning this 
invention. 

[0049] The image-processing section 1 8 is a means to perform the image processing which analyzes 
the picture signal from two sets of CCD cameras 19a and 19b installed in a car, and starts this 
operation gestalt. Here, the configuration and actuation of the image-processing section 18 are 
explained using drawing 2 . 

[0050] As shown in drawing 2 , the image-processing section 18 is constituted including A/D 
converter 21, the 1st image memory 22, the 2nd image memory 23, the movement vector detecting 
element 24, and the movement vector processing section 25. Moreover, the image control section 18 
operates according to the control signal from a control section 1 1 . In addition, although the image- 
processing section 18 processes the picture signal from two sets of CCD cameras 19a and 19b like 
the after-mentioned in fact, since it is easy, it explains the case where the picture signal from one 
CCD camera 19a is processed. 

[0051] In drawing 2 , A/D converter 21 changes into a digital image signal the analog picture signal 
based on the image picturized by CCD camera 19a. Usually, the digital image signal outputted from 
A/D converter 21 constitutes one frame image data for every predetermined frame period, and 
consists of two or more continuous frame image data. 

[0052] The 1st image memory 22 and the 2nd image memory 23 store the frame image data 
outputted from A/D converter 2 1 , respectively. The 1 st image memory 22 stores the newest frame 
image data, and the 2nd image memory 23 stores the frame image data in front of one. Therefore, in 
the image-processing section 18, the newest image data for two frames is always held, and the 
below-mentioned processing is performed using these. 

[0053] The movement vector detecting element 24 detects the movement vector for every field in an 
image based on the frame image data stored in the 1 st image memory 22 and the 2nd image memory 

23. Under the present circumstances, the vehicle speed data outputted from the sensor section 14 are 
used. 

[0054] Moreover, based on the movement vector detected by the movement vector detecting element 

24, the movement vector processing section 25 asks for the distance to the road edge in a transit 
road, and the width of road based on this, and outputs them as width-of-road data etc. 

[0055] In addition, about the detail of the processing in the movement vector detecting element 24 
and the movement vector processing section 25, it mentions later. 

[0056] Returning to drawing l , CCD cameras 19a and 19b are installed near the both ends ahead of 
a car, respectively, picturize the right-and-left side of a car, and output a picture signal. The 
installation condition to the car of CCD cameras 19a and 19b is shown in drawing 3 here. 
[0057] Drawing 3 (a) is drawing showing the installation condition of CCD cameras 19a and 19b 
seen from the car upper part. As shown in draw ing 3 (a), CCD cameras 19a and 19b are attached in 
the car-body upper part of right-and-left both sides at the car front side. CCD camera 19a is attached 
in car left-hand side, and CCD camera 19b is attached in car right-hand side, respectively. CCD 
camera 19a turns to the side on the left-hand side of a car, and is attached possible [ an image pick- 
up ], and CCD camera 19b turns to the side on the right-hand side of a car, is attached possible [ an 
image pick-up ], and is installed by respectively symmetrical arrangement. 

[0058] Moreover, drawing 3 (b) is drawing showing the installation condition seen from the car front 
with the image pick-up range about CCD camera 19a. In addition, since it is easy, only the image 
pick-up condition in the case of on the left-hand side of a car is shown. As shown in drawing 3 (b), 
CCD camera 1 9a picturizes the range of the field angle theta toward a wall surface. Usually, it is 
attached in the include angle at which a path road surface is reflected in the lower part while a upside 
wall surface is reflected in the picturized image. In this invention, the distance DL to a left-hand side 
road edge is computed based on the image picturized by CCD camera 19a. 
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[0059] In addition, CCD camera 19a is attached in a location with a height [ of a car ] of about lm. 
Moreover, in right-hand side CCD camera 19b, it will be in drawin g 3 (b) and a symmetrical image 
pick-up condition, and it will compute the distance DR to a right-hand side road edge. 
[0060] Next, the principle of the image processing concerning this operation gestalt is explained with 
reference to drawing 4 - drawing 8 . 

[0061] Drawing 4 is drawing which expressed the image picturized by above-mentioned CCD 
cameras 1 9a and 1 9b with the model of a pinhole camera. In draw ing 4 , the image plane P0 
corresponding to the photo detector section of CCD camera 19a and the focal plane F corresponding 
to the lens section separate a focal distance f, and are arranged in parallel. The lens core C of a focal 
plane F corresponds to a pinhole, and considers a space-coordinates system (X, Y, Z) centering on 
this lens core C. On the other hand, by the image plane P0, camera system of coordinates (x y) are 
considered by setting space coordinates (0, 0, -f) as the image core c. 

[0062] Here, the point M of a space-coordinates system (Xm, Ym, Zm) is considered. This point M 
can be made to correspond to the position on the wall surface in drawing 3 (b). Considering the 
central projection over this point M, even an image plane P0 is connected in a straight line through 
the lens core C of a focal plane F from Point M, and it is projected on the point m of camera system 
of coordinates (xm, ym). At this time, the relation between Point M (Xm, Ym, Zm) and the projected 
point m (xm, ym) is expressed with a degree type. 
[0063] 

[Equation 1] xm = f-Xm/Zmym = It is drawing where drawing 5 expressed the relation between a 
space-coordinates system (X, Y, Z) and the pixel system of coordinates (u, v) of image data to the f- 
Ym/Zm order corresponding to drawing 4 . Since it is easy, while arranging the image plane P0 of 
drawing 4 to the front side of a focal plane F in drawing 5 , it considers as a pixel image system (u, 
v) by reversing the x axis of camera system of coordinates (x y), and the y-axis, respectively, and 
considering as u shaft and v shaft. Even if it transposes arrangement of drawing 4 to arrangement of 
drawing 5 , since it is mutually equivalent, the same relation is realized. 

[0064] In drawing 5 , the image plane PI of a pixel image system supports the display image of the 
horizontal number Nw of pixels, and the vertical number Nh of pixels, and the pixel of NwxNh is 
contained in an image plane PI in all. On the other hand, this image plane PI is in agreement with 
the light-receiving field of CCD cameras 19a and 19b with which size is set to Breadth w and height 
h. And if the point M of a space-coordinates system (X, Y, Z) is considered like draw ing 4 , as 
shown in drawing. 5 , it will be connected in a straight line to the lens core C of a focal plane F 
through the point m of an image plane PI (u, v). 

[0065] Here, considering the central projection over Point m, corresponding to several 1, the relation 
between Point M (X, Y, Z) and the projected point m (u, v) is expressed with a degree type like 
dr awin g 4 . 
[0066] 

[Equation 2] u = (f-X/Z) -Nw/wv = (f-Y/Z) -Nh/h, several 2 [ i.e., ], expresses the pixel location in 
the image plane PI of Point m (u, v). In several 2, u corresponds to a horizontal pixel location and v 
supports the vertical pixel location. 

[0067] With this operation gestalt, since the image picturized from the car under transit is processed, 
it is necessary to assume a motion of the body in an image plane PI. Therefore, it is necessary to ask 
for the optical flow in an image plane PI, i.e., movement vector V, (u, v). When brightness I of the 
same point of three-dimension space is kept constant, the following differential equation between 
space-time is realized. 
[0068] 
[Equation 3] 

dl/dt = Ix-u+Iy-v+It = It corrects zero and a partial differential with horizontal Ix and Iy are [ a 
vertical partial differential and It of the partial differential of time amount shaft orientations, and u 
and v ] the components of horizontal [ of above-mentioned movement vector V ], and a 
perpendicular direction in an image plane PI, respectively. 

[0069] Next, how to ask for movement vector V using drawing 6 and drawin g 7 is explained. As 
shown in drawing 6 , reference block R is defined in the image plane P 1 in time of day t. With the 
upper left pixel pr as the starting point, this reference block R is the rectangle field of the range of n 
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pixels, and contains the pixel of a mxn individual in u shaft in all at m pixels and v shaft. And an 
image plane PI is divided into two or more reference block R, and each reference block R of every is 
asked for movement vector V. The example of drawing 6 shows reference block R used as m= 8 and 
n=8. 

[0070] Drawing 7 is drawing explaining how to ask for movement vector V to predetermined 
reference block R in an image plane PI . Drawing 7 corresponds to the image plane PI in time-of-day 
t+delta t in which deltat has passed since the time of day t of drawing 6 . And based on the vehicle 
speed data from the sensor section 14 etc., the predetermined field in an image plane PI is 
beforehand appointed as search range S. The search range S is a rectangle field where it becomes M 
pixels on u shaft, and it becomes v shaft with N pixel, and M and N usually become sufficiently 
large compared with m and n. 

[0071] And the comparison block C of reference block R and the same size is defined as a position 
to the search range S. Since size is sufficiently large compared with reference block R, it is 
necessary, as for the search range S, to move the location of the comparison block C little by little in 
the search range S. By drawin g 7 , the comparison block C is the size of mxn like reference block R, 
and shows the pixel pc at the upper left of the comparison block C corresponding to the pixel pr at 
the upper left of a reference block. The pixel at the upper left of the search range S is set as the pixel 
pc of the comparison block C at first, after that, in the search range S, it moves 1 pixel of locations of 
Pixel pc at a time to u shaft orientations or v shaft orientations, and the below -mentioned operation is 
performed about all comparison blocks C that can be defined in the search range S/ 
[0072] Subsequently, a correlation value is calculated between the comparison blocks C in reference 
block R in the time of day t of drawin g 6 , and time-of-day t+delta t of d rawing 7 . Here, in the image 
data which is the set of a pixel, since the concentration value is made to correspond to all the pixels 
of a mxn individual, it asks for the difference of the concentration value for every pixel to which 
reference block R and the comparison block C correspond. A correlation value is calculable if the 
sum about the pixel of a mxn individual is taken to the difference for every pixel of this 
concentration value. 

[0073] And to reference block R, the correlation value during all comparison blocks C in the search 
range S is calculated, and it searches for the comparison block C which gives the minimum 
correlation value. For example, the comparison block C shown in drawin g 7 presupposes that the 
minimum correlation value is given. 

[0074] In this case, as shown in drawin g 7 , in an image plane PI, the vector which tends toward the 
comparison block C in time-of-day t+delta t from reference block R in the time of day t shown by 
the dotted line can be determined as movement vector V. 

[0075] Although drawin g 7 showed only one movement vector V, it asks for movement vector V in 
fact about all reference block R which can be defined as an image plane PI. This searches for spatial 
distribution of movement vector V. And the below-mentioned processing is performed based on 
spatial distribution of this movement vector V. 

[0076] Next, the above-mentioned distance DR and DL and the calculation approach of the width of 
road are explained using drawing 8 . Drawing 8 is drawing showing an example of distribution of 
movement vector V in the image picturized from CCD cameral9a. In drawin g 8 , since it is easy, in 
the longitudinal direction of a car, the case where the path road surface and the wall surface have 
touched in the boundary section 30 is assumed like drawin g 3 (b). Moreover, distribution of 
movement vector V on Rhine LI in time of day t is considered. 

[0077] As shown in drawing 8 , in the image picturized in CCD camera 19a, the magnitude of 
movement vector V is changing with the rate of change of abbreviation regularity by the path road 
surface in the lower part of the boundary section 30 to the magnitude of movement vector V serving 
as constant value on the wall surface in the upper part of the boundary section 30. Thus, the 
magnitude of movement vector V serves as a value depending on the distance z to a photography 
object. 

[0078] That is, supposing it performs the image pick-up by CCD camera 19a by frame period T in 
the car it is running at a rate vO (m/second), the migration length d of a 1 inter- frame car is [0079]. 
[Equation 4] d = vOandT (m) 

It can express. Here, if a photography object considers the situation which does not change only in 
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the direction of u in a motion, the direction of v, and the direction of z relatively [ car ], the following 
formulas will be realized that what is necessary is several 2 just to substitute above-mentioned x=d. 
[0080] 

[Equation 5] u = (f-d/z) -Nw/w = (f-vO.T/z) It can express -Nw/w. Movement vector V (u, 0) 
becomes settled by u shown in several 5, and this u is in agreement with the magnitude of movement 
vector V. Thus, the magnitude of movement vector V is in inverse proportion to the distance z with a 
photography object. 

[0081] Drawing 9 is drawing in which the magnitude of movement vector V of Rhine LI shows 
signs that it changes corresponding to several 5. In drawing 9 , while a continuous line shows the 
magnitude of the movement vector of a photography object to v shaft in the image of drawing 8 , the 
dotted line shows distance z. Since distance z becomes fixed, on a wall surface, it becomes fixed 
[ the magnitude of movement vector V ], so that draw ing 8 may show. On the other hand, since it 
becomes small at a rate of abbreviation regularity so that distance z goes by the path road surface 
caudad, several 5 u becomes large linearly. 

[0082] Therefore, in draw ing 9 , movement vector V cannot change with the rate of change of 
abbreviation regularity, but can distinguish a wall surface and a path road surface based on whether 
it becomes in general fixed, and can also judge the location of the boundary section 30. And MV 
(pixel), then the distance DL to the above-mentioned wall surface are based on several 5 in the 
average of movement vector V of a wall surface, and it is [0083]. 
[Equation 6] 

DL = (f-vO.T/MV) -Nw/w can be computed and calculated. 

[0084] In addition, although movement vector V becomes small with the rate of change of 
abbreviation regularity as it goes above an image by the path road surface when a slot exists in a 
road edge, on the boundary of a path road surface and a slot, it changes uniformly [ rate of change ] 
and rapidly partially. Therefore, a slot can be detected by distinguishing this break point, and the 
distance DL to a road edge can be found based on the magnitude of movement vector V before and 
behind that. 

[0085] Moreover, what is necessary is to generate two or more fields where movement vector V 
becomes in general fixed, when becoming a partial wall surface like the guard rail instead of a single 
wall surface, but just to use the distance DL which finds the distance DL about two or more fields, 
among those serves as the shortest, while detecting a break point as mentioned above. Also when a 
guard rail adjoins a road edge, the distance DL of a road edge can be found based on the distance to 
the field corresponding to a guard rail. 

[0086] In addition, as an example of each numeric value in several 5, it becomes focal distance f- 4 
(mm), horizontal pixel number Nw=320 (pixel), and breadth [ of a light-receiving field ] w=4(mm) 
frame period T=l / 30 (second) extent. . 

[0087] If the above image processing is similarly performed to the image by two CCD cameras 19a 
and 1 9b, the distance DL and DR to the road edge in right and left of a car will be found. Therefore, 
while adding these, in consideration of the breadth of a car, the width of road in the road under 
transit is further computable. For example, when a car has Breadth W in the installation condition of 
drawing^ (b), the width of road RW is [0088]. 
[Equation 7] RW ** It can ask in approximation with DL+DR+W. 

[0089] In addition, if the width-of-road data corresponding to the computed width of road RW are 
related with map data and memorized possible [ updating ] in the width-of-road data storage section 
13, it can use for various kinds of below-mentioned processings. 

[0090] Next, the concrete image processing in the navigation equipment concerning this operation 
gestalt is explained with reference to drawing 10 and drawing_l 1 . Drawing. JO is a flow chart which 
shows processing for the car under transit to prevent approaching a road edge, and drawing 1 1 is a 
flow chart which shows processing for the car under transit the road of two or more lanes to make it 
run a proper lane to a setting path. In addition, drawing 10 and drawing . 11 are processings mainly 
performed according to control of a control section 1 1 . 

[0091] If the processing shown in drawingJ O is started, the distance DL and DR to the road edge of 
both sides will be found, and the width of road RW will be computed by processing of the above 
image-processing sections 18 according to several 7 based on this (step SI). And the width-of-road 
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data corresponding to the width of road RW computed at step S 1 are related with map data, and are 
written in the width-of-road data storage section 13 (step S2). At this time, it may be made to write 
in width-of-road data in the predetermined point path on the street set up beforehand. 
[0092] Subsequently, based on the distance DL and DR acquired in step SI, it is judged whether the 
car under transit visits a road edge too much (step S3), namely, what is necessary is to set up a 
predetermined distance used as criteria, and just to judge that a car visits a road edge too much and 
comes out to it, when distance DL or DR serves as a small value from this predetermined distance 
[0093] When the decision result of step S3 is "YES", a car visits a road edge too much, and comes 
out to it, and it warns a driver of a certain thing (step S4). For example, what is necessary is just to 
output as voice the predetermined message which visits a road edge too much, comes out to it, and 
shows a certain purport from a loudspeaker 17. Or the same message or a display notation may be 
displayed on a display 16. 

[0094] After finishing step S4 when the decision result of step S3 is "NO" or, it judges whether a car 
is running or not (step S5). When a car is not running (step S5; NO), since it is not necessary to 
perform an image processing, processing is finished. On the other hand, when a car is still running 
(step S5; YES), processing of step SI - step S5 is repeated. 

[0095] In navigation equipment, real time can be asked for the always exact width of road RW by 
processing the above step SI - step S5. And since it was made to warn a driver when the distance DL 
and DR to a road edge was supervised and the car under transit visited a road edge too much, 
operation of a driver can be assisted and the insurance under transit can be secured. Moreover, since 
width-of-road data were suitably written in the width-of-road data storage section 13, when running 
the behind same road, it becomes possible to utilize width-of-road data effectively. 
[0096] Next, the desired destination is set as navigation equipment and processing shown in drawing 
1 1 is performed under the situation that a path is judged. First, like step SI, the distance DL and DR 
to the road edge of both sides is found, and the width of road RW is computed further (step SI 1). 
[0097] And the lane information over the lane under transit included in the map data of the map data 
storage section 12 is read (step S12). Since the road under transit is the information which shows 
**** w ith what lane, this lane information judges whether the roads under transit are two or more 
lanes based on lane information (step SI 3). 

[0098] When the decision result of step SI 3 is "YES", based on the decision result of step SI 1, it 
judges which lane is under transit among two or more lanes now (step S14). This judgment can be 
performed based on a ratio with the distance DL and DR to the road edge of the both sides of the car 
for which it asked at step S 1 . 

[0099] Then, the lane judged at step S 14 judges whether it is a proper lane corresponding to the path 
which arrives at the destination (step SI 5). That is, if the case where it is running the road of three 
lanes, for example is taken for an example, you may be which lane when a right-hand side lane 
becomes proper when turning to the right ahead generally, a left-hand side lane serves as fitness 
when turning left ahead, and going straight on as it is. Or the information on the proper lane at the 
time of left turn and right-turn may be set up beforehand. 

[0100] As a result of the judgment of step SI 5, when the car is running the proper lane, processing 
(step SI 5; YES) is finished. On the other hand, when the car is running the lane which is not proper, 
guidance of lane modification is directed to (step S15; NO) and a driver (step S16). for example, the 
case where it is running the left-hand side lane before the right-turn point — already — what is 
necessary is to output as voice the message of a purport which urges moving to 2 lane right to a 
driver from a loudspeaker 17, or just to display it on a display 16 

[0101] In navigation equipment, the lane in which a car is located by the road of two or more lanes 
can be judged on real time by processing the above step SI 1 - step SI 6. And unnecessary guidance 
does not need to be performed, when guidance is performed only when required and it has already 
run the proper lane, since it was made to guide lane modification to a driver only when it was not 
located in a proper lane, in order to perform right-turn, left turn, etc. Therefore, convenience is high 
and much more comfortable navigation becomes realizable for a driver. 

[0102] In addition, in the example of drawing 1 1 , only while the car is running the lane which is not 
proper, when directing guidance of lane modification, namely, while running the proper lane, the 
case where guidance of lane modification was not directed was explained, but it is not restricted to 
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this, but while [ when a car is proper ] running, it may be made to perform a certain guidance. For 
example, while running a proper lane, guidance of "please maintain the lane of this as" may be 
outputted with voice etc. Thereby, the driver under operation can be made to be able to grasp 
running the proper lane, and sense of security can be given to it. 

[0103] As mentioned above, although this invention was explained based on the operation gestalt, 
this invention is not limited to the above-mentioned operation gestalt at all, and it can guess it easily 
for amelioration deformation various by within the limits which does not deviate from the meaning 
of this invention to be possible. 

[0104] For example, you may make it display the image picturized with CCD cameras 19a and 19b 
as an image pick-up means on a display 16. With this operation gestalt, since it is installed so that 
CCD cameras 19a and 19b may picturize the just beside direction in the car front, before a driver 
arrives at the location which can see the side directly, on a display 16, a side image is checked by 
looking and the thing of it can be carried out. Especially when a car advances into a crossing from a 
narrow alley, a side image can be checked by looking only by taking out a car tip to a crossing 
slightly, and it becomes useful at insurance transit of a car. 

[0105] Moreover, although the above-mentioned operation gestalt explained the case where it was 
installed so that CCD cameras 19a and 19b as an image pick-up means may picturize the just beside 
direction in the side of a car, it is not restricted to this, but you may install so that the direction of 
before [ slant ] approach in the side of a car may be picturized. Thereby, a side image can be 
preceded in time, and can be processed and the distance to a road edge can be found timely. 
[0106] Or you may install so that the direction [ in / for CCD cameras 19a and 19b / the side of a 
car ] of the bottom approach of slant may be picturized. Generally, if CCD cameras 19a and 19b with 
a vertical narrow field angle are used, when a car approaches a road edge, the case where a road edge 
stops entering in an image will arise, in such a case, since it comes out, and a road edge will enter in 
an image if the image pick-up direction of CCD cameras 19a and 19b comes together the bottom and 
there comes out and is even if it is, it becomes possible to find the distance to a road edge. 
[0107] Moreover, CCD cameras 19a and 19b which have a larger field angle may be used. For 
example, when a horizontal field angle performs above-mentioned processing separately to the left- 
hand side field and the right-hand side field in each image pick-up image using some CCD cameras 
19a and 19b about 180 degrees, the distance to a road edge may be found. The distance to a road 
edge can be found thereby still more finely. 

[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing. 1] It is drawing showing the outline configuration of the navigation equipment concerning 
this operation gestalt. 

[Dra win g 2] It is drawing showing the configuration of the image-processing section of navigation 
equipment. 

[Drawing 3] It is drawing showing the installation condition to the car of a CCD camera, and the 
installation condition which looked at (a) from the car upper part, and (b) are drawings showing a 
right-hand side installation condition from the car front, respectively. 

[Drawing 4] It is drawing which expressed the image picturized by the CCD camera with the model 
of a pinhole camera. 

[Drawing 5] It is drawing showing the relation between a space-coordinates system and the pixel 
system of coordinates of image data. 

[Drawing 6] In case it asks for a movement vector, it is drawing explaining the reference block 
defined in an image plane. 

[Drawing 7] It is drawing explaining how to define a comparison block as search within the limits, 
and to ask for a movement vector from the predetermined reference block in an image plane. 
[Drawing 8] In the image processing concerning this operation gestalt, it is drawing explaining the 
distance to a road edge, and the calculation approach of the width of road. 

[Drawing. 9J it is drawing explaining signs that the magnitude of the movement vector in an image 
and distance with a wall surface change. 

[Drawing.. 10], In the navigation equipment concerning this operation gestalt, it is the flow chart 
which shows the processing for preventing that the car under transit approaches a road edge 
corresponding to width-of-road detection. 

[Drawing 1 1 ] In the navigation equipment concerning this operation gestalt, it is the flow chart 
which shows processing for a car while running the road of two or more lanes to make it run a proper 
lane to a setting path corresponding to width-of-road detection. 
[Description of Notations] 
11— Control section 

12 — Map data storage section 

13 — Width-of-road data storage section 

14 — Sensor section 

15 — Current position detecting element 

16 — Display 

1 7 — Loudspeaker 

18 — Image-processing section 
19a, 19b -- CCD camera 

2 1 — A/D converter 

22 — The 1st image memory 

23 — The 2nd image memory 

24 - Movement vector detecting element 

25 — Movement vector processing section 
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a. mn 1 2 XteW^Jl l 3 fcriB®^-?- a > 

[0032] zcomitzxtux^ j&ri'?zim-ci±. m 

Lxmm : ?-?bmgrJi*x8m-&%t\ 

[0033] mzm 1 5 cioaow-b**-*-^ 9 >mm 
«. isiass 1 4 izsmo-i-vy-i, 3 

-*k mgr3irzmmmiz§im-2>Mii&T-?5Z&& 
&&mizffiz.& z b zmmt -rs . 

[0034] ^W^fcrJ:^. *ttffl^-b>'->- 3 > 

nam. mm?-fm£^mz±^j:dtzm>tzm. 
^z^m-^mMf-^ irmsfmmizmm-^ . 

ft. St^PItiaSS-iio^h^tcSfflT'^-ScO-C. ^b* 

[0035] wmm. 1 6 tcisscoi-b*^-^ 3 >mm. 

«. IS«^ 1 4X»i^*JS 1 5 £ffi*itf>^b>*-^ 3 > 

mmzawx^ mmmm&&bmmim$!&®t(v 
ufttsmz&rs^xmm^fim&zmf^&Tttim 

[0036] zco^miz £ti&. my—>3 >mwx 

mRzsmmt,zm~3%7&tfm&z¥Bgtz. zlx. we 
ztvrzimtfmsmmbm&ztix. zammzm^ 

[0037] 1 7 ^ta®co^b-y-^ 3 
*i. etcffi^tfoi-b'y-^s y^a^i5v>-c. 

k£«&ki-s. 
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[0038] i^^tc if ur . tmi 1 6 t~ia®tfo% 

[00391 m#r 1 8 (caaco^b-y-^ 3 ysa 
mmi 6{=ieK^b'y-^3^atcfev^T. 

[0040] zanrntzxtua* m%m i e icsbosi 

20 [0041] 

i%pn<7mm<mmi jar. *&w<r>mg&mM<mm. 
zmmizm^xwrn-tz. a.T<omk<mmizi5vyx 

ffl Lfci^-fc:-?vvtS&Jifrr-g, . 
[ 0 0 4 2 ] 0 Hi. 4^attBStfli« my— is 3 V 
S^COll»&8tJ££^0T£> . 0 1 tc^rr^b'^->' 
3 >-iia{±. 1 1 i: . ttS-r-^«1S^ 12k, 

inis^-^e^ i3k. -ty*« i4k. ^aa^ 

aiS815k. f-fX7W 16k. Xb"-^17k. B 
30 fJP3!18f:. CCD^519 a> 19bkStA 

[00431 fiUKDWjftC&t vC . SlgfSl! 1 1 Ji. -?-b* 
y-S/ 3 >-iia^«£i0iW^Sr©J»-rs . SflfliSS 1 1 {iC 

o^ASrgg^aiLT^TL. -^b'^-v-s^a^ 

[00441 tfiS'r-^iatigs i2ii «af-^ »e 

40 OM-^DVD-ROMfr'ffi^ixS. fflif- ^IBIigP 

1 2{c*siftsixs«!0T-^i±. m&mt-r—?. &k 

[0045] iHlir-^IEiigE 1 314, 4^mtcA&V 

50 (cov^TtiftaW-^. 
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[0046]* 1 4 1*. jeB^ffiaasrEiaj-r 

GPS (Global Positioning 
Systea) ffiSA»€»<0*jft£gfi-r h G P S&WM&Z 

[0047] mjEtzmmixm i -tyv&i 4 

[0 048] f^X7W 1 6(Cli. SglWgBl lcoigjfc 
ix&„ Cl<5>r*.X7"V4 1 6fcL MitfCRT, jgtA* 

[0049] Bm«^gP18«, mStc^MSfLS2^ 20 
«CCDW519a, 1 9b*^iO®®fi-^SrjB*fL 

[0 0 5 0] a2fc:^-J:dt=. BfiW&a^l 8«. A 
/D3yyW2U» SIlMflbt^i; 22fc. 352B 
SIX* U 2 3 . h>vm&U2 4 , #SK<? 

Wl^S2 5£#^TfliJft£;ftX^S. B«#J 

i. Srii. BISJSRISBI 8{i, I^HCte&S&Oj: 3 t=2 30 

^ccD^7i9a % 1 9b fr^crm&m^ym 

[0 0 5 1 ] 02fci5wr. A/D3y;W2Ui. 

CCD^7 1 9 aicj:-?Tan£*i&Kfce&?<r 

J&XoSrS. 40 
[ O 0 5 2 ] S 1 It^t 'J 2 2MS2I«^=E 'J 2 
3Ji. fiimA/DayA- ?2 l*^tiJ^5ixS7 
£*g*fr?--S> . 85 1 H&;< *U2 2 MJt 

mcoyu-j^mmf-^^mmL. 1211^*'; 2 3 

{41OBUC07U— AMflW— *£fi*W4. Jr-?T. B 
&*!USgS 1 8 T'ii . %ttzm%i<?> 2 7 l/-A^)Iff- 

its. 

[0053] ^iS^? WL4AifiS2 4 tt. » 1 B&> ^ 
'J 2 2AtnR2Hflbt%U 2 3&m%tl&7l'—J-M 50 
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[0 0 54] ifc. &tt"t?M4[!&S2 5tt. #«K< 

-?<aMS*$tf>. iHS^-^^t ltbkiw-*. 
[0055] SriS. ^ift^? hMftffl*2 4 

[0056]@ltlot, CCD^7l9a. 19 

fc, CCD^519a, 1 9bff)MW^OmMMmt: 

[00 57] 03 (a) it, *HJJ5r5&»fe^fcCCD* 
X519a, 19b<aRKm&*rfB-C&S. B3 

( a ) KJjcf <fc 5 CCD^519a, 19b<2* 

S. 9 a**3Jt£Mfe:, CCD^7l 

9 b&mm£;mizzii?tismv-t>tix^& . ccdx 
ttfefu ccDW 7 i9bii, j£B*W9Httr£fS|^ 

[00 58] ^3t. 03 (b) »i, CCD^7l9a 
4fc®<7)^ LTV 03 (b) tSfiolc. CCD 

tvtti. CCD*^7 1 9akriOS«$^3tBM(cS 

[0059] 3ri3, CCD*^7l9ail ^B?>S$ 
^lm^ea^SXf+ft^fLS. ifc. *ffl!cOCCDX» 

5i9bco^-{±. @3 (b) tftmm*mmimt* 

[0060] act:, ^QttStt(Zfl(«BfiKX»OJIEa(= 

ov^T, H4~08S:#HgLT^BW*. 
[006 1 ] 04{i. I53*<?)CCD^^91 9a. 19 
btcj; 0Sm$iX3tBm5rtr>7jt-;^^7^x^T' 
^L/i0T*J>-6. 04{C*3V»T<±, CCD^7l9a 

co%%m?fflzttm-i-&wm*?wpot. uyxmztt 
m^-^m^MF t»Mkji®m t *mxx*m\,zwm-zix 

Z^uyXtp^c^L-^z^m^WJ^ (X, Y. 
Z) Sr^i.S„ Mm¥®P0T'{±. 
(0, 0. -f ) £B&4M>cfcLT. 
(x, y) 
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[00 62] <I <IT\ £l3^«^<a£M (Xm, Ym, 
Zm) £<7>j£M« H Mt\$m3 (b) 

il. *X5mWM<0&m (xm, ym) (C8t^§tLS 0 

j&M (Xm, Ym, Zm) tft^iut^m 
(xm, ym) COmm±<t&tTmZiX&. 
[0063] 

" [ISl 1 xm = f - Xm/Zm 10 
ym = f ■ Ym/Zm 

_ »:(c05(i. @4£#klt. gmmm& (x, y, 

Z) ^M®x-^coe^Hr;^g^ (u, v) <?M&* 

«^fflP0^^ffiFofn6-ffl|(cSlM$-fr^h*fc:. * 
*^M^(x. y)c7)xtt. ymi^it^tlMM^ 
tu|, viW^i:^^ tT?-fc^Bt&^ <u, 

v) tLfci>cox*$>& 9 m4<7>mm&m5(?mmzw% 

L 20 
[0064]i5 {Z&^X. e^-fe^Mfi^com^M 

phi fc^fttommwcNvrtmmxfa&mm&Nh 

a. 1 9b<D^3fc®«£— STT-S. -£LT. 04t^ 
^^S^m^^M (X, Y, Z) H5£ 

^-r £ a fcr. h^sp i oj&m ( u , v ) £*i^t& 

MMF cry V yXfybC & X^nx-tetftlZ , 

[0065] ZZX\ M4tWimiZ. jftmfcSH-S** 30 
Sti*£#;L&i:. I&lKStJELT. jiSM (X, Y, Z) 

fc»res*ij!b&m (u. v) com%\r<x^^tLh. 

[0066] 

[&2 ] u = ( f - X/Z ) - Nw/w 
v = ( f - Y/Z) • Nh/h 

»2tt. jSm ( u . v ) (7)MSfffiP 1 fc*5 

[0067] *SO»BW«±. +^>«W3&»6««$ 40 

v) fc««>i«ea?*s*s. 3ij^t^^coi5|-^<7)0j^$ 

[0068] 
[»3] 

dl/dt = Ix-u+Iy v+It - 0 
fc*£U ^ix^ixB^ffiP lrtfcr*$wc. Ixtf*T 50 
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:«rrt0>ii»4h i yimm^nmafo* itsw*iai* 

[006 9] iJcfc. H6a^H7tfflV^T8P|K^ 

lx. uicmit, v «^ n mm<D&m<o$mmmr 

tS^ffiP 1 «»*>tHH:/a?^Rfc^JU 

"CfcL m=8. n = 8i:^l,#»3/n7^R5:*LTV^ 

[ 0 0 7 0 ] H7MU BflffiEP 1 W^O0rSo^^o 

»*. H7I4, H6^at*»feAt*SBaLfc*J9t 
+ Atfct5*t4B«TlfPlfc*tJ&r4. -tLT. -irv 

t3l4^ t>commy i —?mzM-5\< ^X . B&¥MP 1 

»S«t*oT, MSI*. M. N#m. nfcjfr<4fc + 

[007 1] ^LT. t-f3MS{;SL, #^^n*y 
9 R fc HIM XcDJtK^o y 7 C £Bb&OfiKBfc5£»3- 
4o ^-^OTSI4#i|yav^R»^/<^>fX*H-» 

li^yo^^RhPiaitCmXn^-fXT&D. #»§ 
^E_bcoHSpcSr^LTV^. ftttl±1F-"?-KHS<7!>;£ 

^■fg^T^itK^a y ? c fcov^T«»0i(dl*ff 

[0072] arwc. H6con*aaitfe:t5tt*#8a^o^ 

-^Tii. mXnffl^rcOBSfcfflKfiSitiBSiir'C 
#SS^o*y^Ri:Jt!Rro^^CO»IB"rS 

CT^:^>I^>^L. mX nMcOW^lZ-O^X <0%}% bit 
[0073] ^LT. WH^n^RteSU 

Hsco^^T^jt^yo v ^ c tcomcommmzx 

Witf. 07(^-rJt«eyn-y^c^S/J^ffl^fi^4- 

[0074] ^co^ii. H7«z5r«-jtd(=. mm^m 



1 3 

[ 0 0 7 5 ] 07 X'ii 1 r><7)&W<-7 Lfc 
JOKcUS!^? WPV£. Mtfe^SP 1 f3WT 

:007613:C, 08£fflWt. iJ&OffiStDR. D 

LRtsmmvniiiifmzwmtz. msi*. ccd^ 
(b) tamiz. m&mnfatz&^x . n^M^ii 

#^#33 0fcTgLTVv&^£«Sgi-.S., ( B$ 
S"Jtfc:t>ftS5>f >L1Ji<0^MK<^ WI/VO#flj£# 

[00 7 7] 08 £^±31;:. CCD^7l9a{: 
TiiMSfcjtWaKfcVvc. *Ji#gB3 0<Z>_hSRfc:S>&M 

<c*fU Ji#g53 0<VT&l,z$>&W&mX'i&my<7 h 

m*tz&tfLfcmt%z>. 

[00 78] tttt. MvO (m/&) -Ct^tLT 
V^fSCfeWT. 7W-A1ITTCCDA^5 19 

[0079] 

[&4] d = v 0 • T ( m ) 

3i2r#i.&t. ±Mcr>m 2 x = d &ftA-T*Uf i < . 
[0080] 

[&5] u - ( f ■ d/z) • Nw/w = (f 
• vO • T/z ) • Nw/w 

v (u. o) *^*o, zcr> uimm**? htUV <F> 

[008 1] 09 1±. ^yLlO^ftK^HUVO;*; 

turn®®***? hJM^z&msix^Ttmz^ sgsiz 
}f^—^m^x'A^<^s:h<r)x\ WL5cr>\i\±mm.mz 



(8) i!2001-34769<\ 

1 4 

[00821^-jT. 09fciiVvC. SW<? h/Wtf 

[0083] 
[1*6] 

D L = ( f • v 0 • T/MV ) • Nw/w 
10 £gfctiLT:£#>S.r 

[ 0 0 8 4 ] &:fc. MKSgtatg5^#^S^{i, a 
HlTCttHtte>±£rC:fT< (=OirBg— 5g<7)^^*T#SJ 

^lz&4tmi^feCl±&<M8ll,zm&&. ioT. 
[0085] m— c0SffiT-«=S:<. Mi.tfXr— H 

d l suit, vtitf j: m&mztf- k i^-^aqsag-r* 

[ 0 0 8 6 ] 5rtJ . jR 5 (=t>{t-S.«^tficOA#*«k LT 
ti, M^ffiStf =4 (mm) . *^ffiJ<OB*ScNw= 
3 20 (t^-fe^) . S7fe««W«Hgw=4 (mm) . 
yis-J±mMT=l/3 0 (®) WZIZZZ . 
30 [0087] PXtcrmmmZ. 2-?«0CCD^7l 
9a. 19b(cJ:ftBflU=jttLmR(=firi.if. «^co£ 

tx. imi&tiBmz&»&mm&mtt&zkwr& 

*. 02 (b ) aK&tmt^ivc9«#mK 

[0088] 

CSC7] RW ^ DL + DR+W 
40 [ 0 0 8 9 ] Srii. *ffi3*l£3Bff RW(3kf J&f&j&K 

[0090] <Jcfc, sfcmBS^flSS-M^y-^ a >§l 
*fcJ3ltift*flWrBflW!!BlfcHL. 01 O2iOf01 1 

VT-ftO. 01 Hi. ^S^ISOjlffi^tT^*^^ 
50 •t7n-f-^-h-c*4. ^riJ. 01 O&tf01 1{±. 
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iLizmwm 1 1 wMm<,z&r>xftbti&wmTh& . 
[009D hi oiz^jmwmiiiitizb. ±m<o 
x d zmmmgn i semmizi o . mmvmift* x 

TSHgRW#gtiJ3;ft.5 1 ) . X 

«i&r-* t mm^if^tizmmf-^s&m i 
3i£»&ii£*u> (xf7rs2) . z<ot*. "?#>m. 
&.ztit:ms&±.(?)m3£(v*:4 yhiza^x. mm?-? 

evmZj&frZffoXolzLX&J:^. 10 
[ 0 O 9 2 J i5C^-C\ Xr- yy-S 1 C^vt^&iXJtgg 

^6t^0f^lE»ISr^LT*5#, E8SDL 

[00931 Xf -yT-S 3(Vp]gmZ&& r YE S j T£> 

JSS'fft* M-Sr^-TH^^ y . X fc*-;& 1 7 20 

•fe— i^Mm^SMm^f^ KTVA 1 6tfsrcLT*> 

[0 0 94] X^-yTS3c9*iJWii£Si** TNOj 

•C&S^^SrflBrTS (Xf77S5). IS^Stf 
cfT^rV^- (^f77S5 ; NO) „ ffifcgUSSrfH 

TiS^- (Xf-y7S5 ; YES), Xf»/7S 1~ 
Xx-/TS5cO«iaS-Mi0il-r. 30 

[0095] -t-h-y-v- 3 ^attjv^-c. feLh?).x-r 

-/T-Sl— vTS5<0*!UI£fT J: 
jB£5:jHgRW£ >J T)V9 A Atfftl, £ t & . 

*m&£m®ctz>zkifix'zz>. mm?-?* 

i&l&r-^fElig? 1 3 J: o te 

vs^-rsdtA^rigi:^. 40 

[0096] JJcfc. 01 1 lc*-f*JUi{i. -^t-y-^a 

>mwizmm<nnttomm5s.zti. mmmm^ti^ 

$LT1,zXftbti.& . Xf77Sli:»LT, 

4§RW#gaj$;ft-& (Xfy7S 11). 
[0097] ?-U, flfiHx— 1 2i?5ifillx— 

i2)„ zcom&mmii. 7&rfit><mm s 
mmkx-&hz^-tmix'hz>tz#>, mmmizm-iz 
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77S13 ) . 

[0098] Xf77Sl 3ermffl&%& r YESj f 

xf77si i<&ms&&(,zMr5\^x. im 

(^f»/7S14) . Zc^mi^ ^f»/7Slfct* 

frttmcomm<?ximv8& x'<rmm> l t d r t <oitiz 

m^XffoZttfXZZ. 

[0099] m^x . xt- -/rs 1 ix'WszztuzmSi 

S*^M®fi-S (Xff7S 15). -TSri^ 
smiStOJlKS-^UTU^^SrffltctSi:. HEW 

[0100] X^ yT-S 1 5OWS£<0j£3k ^M*9§jE 
^^SlSr^ff LTl-^^&ti (^7-c7S 1 5 ; YE 
S) *!UI5:i&£S. mH^jajETa^^^SlSr^ 
ffLTV^ii^i (XT77S1 5 ; NO) „ K^A 
-tC^ia^S^rt^*i*t-S (X^-y^-S 1 6 ) . 0l| 

or£. t>o2 ma&izmrtz ztzv^A ;<-izm- 

WtC0j( v^—iSZ^ xtf— ^ 1 7*^^fc LTK7J 

ftSV^iix-f X7-l^-f 1 6fca^K$-*UfJ:v*. 
[0101] ^b'y->-3 ^g{cfcV%T. VJJkVXt- 
77S1 l-^f'y7S 1 6^Oi!!ia?rffdC:i:(cJ;0. 

[0102] ^rtJ, 011 cO^T'ii, mpfASjffiETIisS: 
«MBSe«Mla*JSiB*L«HrV»^tBfiHLfc3&». lilt 

T^t^$r-5-£ 5 Z t &X-Z h . 
[0103] SHl9BJBtC«^**»W*ilWLfc 

[0104] mm^ mm^&t vx<r>o. cd^71 
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9 a. 1 9bt,kDS&L7tS®£x-fXrW 1 61Z 

m^rr&xdizLxi>x\,\ *mmmz'\±. ccd# 

6izxm%wmzwm.-?&ztT*&. ^t. mmtm 
\,wm*b$^izmx-fzi§£%k'i±, mmjo®*®. 
frtem&iziii-rttrcmxwmzmi-c* . mss^ 

[0105] JtfEHSBBJg-m. LT 
<0CCD^7l 9 a. 1 9 btf^MiOOfrttelt&K 

zmzm^ti-r. m*(?>mn\,zt5V&m>ffim*)-}i 
mmm-z*oizmmLxi>5;^. ztuzx*)^ 

-KStBsga -roraEfrSft * £ t #r * s . 

[0 10 6] &£W±. CCD^51 9a. 19b?: 

t # t^WStfertKA^SK =2:4 t * . 

.Ttf>J: 5 oTt>.. CCD^519a, 19 

[0 107] iOjK^gftSr^&CCD;*^ 
19a. 19b SrfflWCfc ±V\ #|;c.i;f . tK^F^TpKOS 
Ml 80gj£<J,5CCD*^7 1 9 a. 19bjffl 

*ii?ii<v&®wmz&if&t£m<omtgt45mc?>m 
mztf L%miz±i&wm*fr ? £ t iz j o . ms&ag^ 
•c«offi«ts-*«>T i> i v k <r tit i o . . — m z 

[0 1 08] 

ft<m<m&m&*?m®-T- 9 nam* a . sw<^ 

ttfcffJffittSrig»SC:i:3&^iei:=S:S. 
[ 0 1 0 9 ] £ fc . *^Sr^-h'^->- 3 VHSK^ffl 
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[0 1 ] *HSBB.@t^S^-b>--^ 3 ^S^«B&lf 

[03 ] C C D^^7C0*Pf^)ga«®5r^'r@-C& 
0 . ( a ) \SMm±*fr^zWLWW&. ( b ) 

[04] CCD#*5fci9m£*t*:Ii&£^>-*- 

10 [05] gmmwMkmistf— ^w^^mm^^m 

[06 ] Yfr*tthWtmSIHWt\\£&tfr 
StM/O >y ? fc-PV 0T* s . 

[07] Htfe :! FfflrttfOE^<^#ag7'a.y^C«-L. -9-— 

[08] xmsmmtzmzmmmizts^x . sk^s* 

[09 ] Bffif*J03f£i&'<.? hvKO*# S&tfMffifc vm. 
20 je*^^SaH i 2:liiB#r50-CS)S. 

[010] 3*^gM5JB®(C^5^-t-y— 3 >-5|g{C*J^ 

[01 1] ^te»St^S^-b*y-^3^Sfc:tjv^ 

5:^-^-7 a— 7^— h X'$>& . 
30 11- 



40 



1 2 
1 3 
14 
1 5 
1 6 
1 7 

1 8 
19 a. 

2 1 
22 
23 
24 
2 5 



1 9b-CCD^5 

IB 2 sal* %u 
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II] 



[H8] 



1/ 



£«ft 



SBftft < > 



18 



a « * a * 



16* 

cco*y 5 



Ik >jk i 



CCOA>7 



111] 



[B2] 



21 

V 



T 



v 



1 U 



J. 



23 
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[03] [H5] 



SUf F PI 
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[07] 




(51) Int. CI. 7 m%im^ F I (##) 

G08G 1/04 G08G 1/16 C 

1/16 G0 6F 15/70 4 1 0 



F^-A(##) 



2F029 


AA02 


AB01 


AB07 AB09 AC02 




AC04 


AC09 


AC14 AC18 


2F065 


AA06 


AA12 


AA22 BB13 CC40 




FF04 


FF09 


FF63 FF64 FF67 




JJ03 


JJ05 


JJ08 JJ26 PP01 




QQOO 


QQ03 


QQ13 QQ24 QQ25 




QQ26 


QQ27 


QQ28 QQ41 SS03 




SS09 


SS13 




2F112 


AD05 


AD10 


BA18 CA05 FA03 




FA07 


FA21 


FA27 FA41 


5H180 


AA01 


BB13 


CC04 FF04 FF05 




FF22 


FF25 


FF27 FF33 LL02 




LL07 


LL08 




5L096 


BA04 


CAG4 


DA02 EA23 FA34 




FA54 


FA66 


GA08 GA28 HA04 



